-- Logs begin at Wed 2022-06-15 23:39:29 UTC, end at Thu 2022-06-16 00:47:40 UTC. -- Jun 16 00:18:33.897462 dv-cinder-845990-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 00:18:33.907220 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 00:18:33.909200 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 00:18:33 2022] *** Jun 16 00:18:33.909200 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 00:18:33.909200 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 00:18:33.909200 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: nodename: dv-cinder-845990-2-iscsi Jun 16 00:18:33.909200 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: machine: x86_64 Jun 16 00:18:33.909200 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: clock source: unix Jun 16 00:18:33.909200 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: pcre jit disabled Jun 16 00:18:33.909200 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: detected number of CPU cores: 4 Jun 16 00:18:33.909200 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: current working directory: / Jun 16 00:18:33.909200 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: detected binary path: /usr/bin/uwsgi-core Jun 16 00:18:33.909911 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: your processes number limit is 47680 Jun 16 00:18:33.909911 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: your memory page size is 4096 bytes Jun 16 00:18:33.909911 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: detected max file descriptor number: 2048 Jun 16 00:18:33.909911 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: lock engine: pthread robust mutexes Jun 16 00:18:33.909911 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: thunder lock: enabled Jun 16 00:18:33.909911 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 00:18:33.909911 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 00:18:33.954303 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: Python main interpreter initialized at 0x558cfe28e9c0 Jun 16 00:18:33.954303 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: python threads support enabled Jun 16 00:18:33.954303 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: your server socket listen backlog is limited to 100 connections Jun 16 00:18:33.954303 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: your mercy for graceful operations on workers is 90 seconds Jun 16 00:18:33.954647 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 00:18:33.954722 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: *** Operational MODE: preforking *** Jun 16 00:18:33.954955 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: *** uWSGI is running in multiple interpreter mode *** Jun 16 00:18:33.954955 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: spawned uWSGI master process (pid: 109458) Jun 16 00:18:33.955140 dv-cinder-845990-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 00:18:33.956171 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: spawned uWSGI worker 1 (pid: 109459, cores: 1) Jun 16 00:18:33.956171 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: spawned uWSGI worker 2 (pid: 109460, cores: 1) Jun 16 00:18:33.956171 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 00:18:34.615043 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 00:18:34.622082 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 00:18:35.791969 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:18:35.791969 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: from cryptography.utils import int_from_bytes Jun 16 00:18:35.793069 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:18:35.793069 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: from cryptography.utils import int_from_bytes Jun 16 00:18:35.794509 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:18:35.794509 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: from cryptography.utils import int_from_bytes Jun 16 00:18:35.794949 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:18:35.794949 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: from cryptography.utils import int_from_bytes Jun 16 00:18:38.374343 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 00:18:38.374910 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 00:18:38.375100 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 00:18:38.375456 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 00:18:38.375706 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 00:18:38.376093 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.376412 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.376729 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.377068 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.377394 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.377697 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.378010 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.378324 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.378644 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.378900 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.379206 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.379523 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845990-2-iscsi {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.379838 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.380137 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.380441 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.380750 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.381077 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.381395 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.381693 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.382178 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.382614 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.382916 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.383220 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.384181 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.384730 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.385074 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.385396 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.385701 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.386018 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.386326 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.386723 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845990-2-iscsi {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.387035 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.387341 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.387649 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.388054 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.388359 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.388664 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.389014 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.389332 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.389633 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.389953 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.390264 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.390575 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.390886 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.390988 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 00:18:38.391356 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 00:18:38.391436 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.391511 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.391676 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 00:18:38.391778 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.392036 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 00:18:38.392124 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.392290 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 00:18:38.392376 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.392622 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.392708 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.392867 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.392994 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.393190 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.393350 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.393504 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.393591 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.393917 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.394105 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.394222 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.394431 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.394529 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.394679 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.394841 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.394925 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.395163 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.395252 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.395425 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.395549 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.395735 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.395832 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.396309 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845990-2-iscsi {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.396408 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.396627 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.396723 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.396951 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.397046 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.397254 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.397351 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.397558 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.397657 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.397855 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.397940 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.398154 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.398237 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.398463 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.398560 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.398771 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.399039 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.399666 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.399926 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.400077 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.400235 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.400396 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.400544 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.400785 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.400870 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.401060 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.401203 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.401365 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.401510 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.401699 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.401825 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.402010 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.402130 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.402312 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.402451 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.402622 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.402758 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.402936 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.403151 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845990-2-iscsi {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.403237 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.403467 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.403582 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.403777 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.403889 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.404087 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.404183 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.404425 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.404520 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.404722 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.404825 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.404999 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.405096 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.405293 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.405405 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.405596 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.405724 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.405904 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.406028 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.406204 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.406365 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.406503 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.406679 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.406809 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.406993 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.407101 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.407307 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.407407 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.407604 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.407688 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.407910 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.407996 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.408214 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.408299 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.408532 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.408617 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.408826 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.408930 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.409151 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.409243 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.409399 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.409506 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.409703 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.409788 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.410019 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.410110 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.410335 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.410429 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.410652 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.410739 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.410901 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.410986 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.411147 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.411239 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.411459 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.411557 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.411773 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.411857 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.412076 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.412169 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.412377 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.412470 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.412680 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.412772 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.413006 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.413112 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.413303 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.413386 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.413608 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.413702 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.413904 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.413990 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.414204 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.414288 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.414511 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.414606 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.414827 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.414920 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.415127 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.415209 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.415420 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.415505 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.415720 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.415817 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.416017 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.416111 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.416310 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.416401 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.416609 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.416696 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.416926 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.417016 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.417221 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.417322 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.417517 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.417602 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.417812 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.417896 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.418104 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.418201 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.418415 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.418510 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.418725 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.418812 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.419024 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.419118 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.419326 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.419418 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.419622 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.419714 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.419933 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.420030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.420182 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.420265 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.420479 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.420563 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.420782 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.420896 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.421121 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.421205 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.421426 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.421521 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.421729 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.421826 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.422033 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.422118 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.422331 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.422417 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.422635 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.422720 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.422937 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.423020 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.423240 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.423325 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.423541 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.423641 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.423845 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.423940 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.424145 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.424238 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.424451 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.424539 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.424752 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.424838 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.425076 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.425178 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.425390 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.425481 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.425701 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.425784 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.426000 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.426099 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.426304 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.426388 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.426607 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.426701 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.426909 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.427001 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.427219 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.427304 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.427519 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.427602 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.427819 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.427916 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.428135 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.428227 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.428442 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.428526 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.428744 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.428839 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.429083 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.429171 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.429384 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.429467 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.429685 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.429778 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.429998 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.430087 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.430330 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.430571 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.430673 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.430789 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.430936 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.431050 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.431239 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.431359 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.431539 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.431668 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.431838 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.431974 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.432136 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.432280 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.432435 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.432586 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.432735 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.432937 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.433059 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.433253 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.433350 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.433565 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.433651 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.433871 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.433956 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.434183 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.434276 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.434489 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.434574 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.434795 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.434880 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.435098 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.435190 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.435394 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.435484 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:38.435692 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.435782 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.435991 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.436078 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.436295 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.436386 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.436599 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.436683 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.436930 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.437018 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.437260 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.437380 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.437576 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.437673 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.437886 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.437978 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.438188 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.438325 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.438491 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.438586 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.438794 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.438879 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.439095 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.439180 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.439393 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.439496 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.439699 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.439784 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.440001 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.440085 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.440297 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.440391 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.440614 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.440709 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.440935 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.441025 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.441237 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.441334 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.441547 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.441631 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.441845 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.441928 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.442142 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.442234 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.442449 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.442534 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.442753 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.442837 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.443058 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.443145 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.443363 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.443456 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.443665 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.443749 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.443981 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.444079 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.444290 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.444393 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.444597 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.444696 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.444922 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.445022 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.445232 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.445317 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.445544 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.445636 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.446403 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.446513 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.446730 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.446822 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.447110 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.447202 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.447424 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.447512 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.447731 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.447814 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.448029 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.448122 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.448329 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.448422 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.448630 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.448715 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.448957 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.449058 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.449259 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.449350 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.449557 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.449649 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.449856 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.449950 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.450154 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.450239 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.450451 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.450535 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.450769 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.450855 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.451074 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.451157 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.451370 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.451460 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.451669 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.451761 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.451964 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.452047 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.452267 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.452359 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.452570 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.452656 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.452934 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.453023 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.453236 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.453322 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.453542 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.453628 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.453860 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.453945 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.454163 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.454254 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.454471 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.454554 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.454777 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.454860 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.455083 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.455174 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.455382 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.455466 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.455687 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.455770 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.455993 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.456086 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.456295 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.456381 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.456610 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.456703 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.456936 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.457037 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.457242 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.457327 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.457552 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.457637 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.457852 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.457944 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.458153 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.458238 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.458462 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.458545 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.458766 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.458857 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.459081 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.459167 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.459391 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.459490 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.459698 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.459784 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.460004 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.460088 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.460314 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.460405 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.460618 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.460710 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.460945 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.461033 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.461255 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.461351 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.462148 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.462251 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.462561 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.462646 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.462872 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.462969 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.463185 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.463269 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.463486 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.463569 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.463792 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.463883 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.464092 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.464176 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.464392 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.464476 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.464696 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.464801 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.465024 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.465128 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.465327 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.465413 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.465631 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.465725 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.465933 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.466018 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.466233 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.466317 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.466534 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.466664 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.466846 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.466930 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.467149 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.467234 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.467449 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.467577 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.467745 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.467828 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.468042 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.468124 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.468342 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.468426 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.468651 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.468743 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.468974 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.469075 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.469281 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.469367 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.469581 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.469667 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.469886 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.469980 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.470187 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.470272 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.470485 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.470579 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.470782 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.470884 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.471086 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.471171 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.471397 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.471489 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.471702 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.471800 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.472015 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.472099 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.472322 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.472405 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.472618 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.472717 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.472959 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.473045 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.473283 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.473367 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.473592 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.473678 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.473887 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.473974 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.474185 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.474270 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.474482 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.474574 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.474819 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.474919 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.475123 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.475277 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.475422 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.475520 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.475730 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.475828 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.476038 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.476128 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.476337 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.476422 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.476641 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.476769 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.476970 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.477108 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.477300 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.477401 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.477612 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.477703 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.477920 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.478014 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.478221 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.478305 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.478524 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.478608 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.478830 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.478930 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.479131 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.479215 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.479433 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.479533 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.479748 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.479853 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.480048 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.480141 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.480349 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.480439 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.480654 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.480747 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.480972 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.481060 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.481278 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.481362 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.481587 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.481673 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.481905 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.482140 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.482225 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.482469 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.482560 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.482779 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.482863 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.483085 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.483169 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.483387 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.483479 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.483694 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.483786 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.484006 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.484098 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.484312 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.484405 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.484618 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.484702 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.484944 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.485049 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.485251 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.485335 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.485550 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.485636 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.485848 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.485931 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.486149 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.486241 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.486446 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.486538 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.486749 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.486886 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.487046 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.487139 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.487348 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.487433 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.487645 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.487765 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.487942 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.488035 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.488240 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.488330 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.488534 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.488618 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.488841 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.488962 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.489158 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.489242 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.489456 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.489539 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.489751 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.489841 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.490063 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.490147 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.490363 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.490446 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.490680 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.490778 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.490953 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.491039 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.491245 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.491338 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.491555 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.491641 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.491862 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.491951 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.492166 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.492257 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.492471 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.492557 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.492858 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.493035 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.493188 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.493359 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.493484 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.493567 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.493788 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.493872 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.494084 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.494175 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.494380 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.494466 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.494686 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.494928 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.495012 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.495239 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.495331 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.495539 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.495623 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.495835 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.495919 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.496140 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.496226 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.496442 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.496526 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.496748 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.496850 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.497073 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.497318 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.497412 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.497648 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.497739 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.497942 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.498034 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.498248 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.498332 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.498550 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.498633 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.498843 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.498973 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.499137 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.499221 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.499438 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.499575 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.499737 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.499823 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.500031 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.500126 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.500331 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.500421 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.500626 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.500760 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.500956 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.501047 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.501253 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.501337 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.501549 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.501646 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.501844 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.501931 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.502143 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.502244 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.502442 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.502527 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.502737 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.502830 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.503035 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.503120 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.503335 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.503421 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.503629 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.503713 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.503924 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.504015 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.504220 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.504312 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.504515 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.504599 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.504811 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.504929 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.505138 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.505224 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.505451 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.505537 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.505758 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.505850 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.506055 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.506140 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.506355 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.506438 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.506654 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.506746 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.506950 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.507072 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.507245 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.507330 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.507544 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.507636 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.507837 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.507923 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.508132 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.508224 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.508973 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.509068 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.509272 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.509365 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.509569 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.509654 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.509883 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.509970 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.510182 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.510272 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.510478 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.510564 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.510774 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.510859 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.511067 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.511151 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.511387 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.511471 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.511687 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.511780 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.511990 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.512074 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.512295 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.512388 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.512592 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.512677 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.512913 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.513009 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.513219 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.513312 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.513523 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.513607 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.513825 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.513916 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.514120 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.514210 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.514414 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.514498 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.514718 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.514801 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.515017 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.515115 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.515310 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.515393 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.515608 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.515691 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.515902 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.515993 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.516212 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.516309 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.516507 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.516591 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.516806 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.516915 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.517128 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.517229 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.517433 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.517518 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.517732 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.517817 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.518023 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.518112 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.518325 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.518471 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.518625 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.518747 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.518921 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.519004 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.519219 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.519311 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.519521 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.519608 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.519817 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.519901 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.520115 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.520213 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.520419 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.520502 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.520722 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.520806 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.521309 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.521410 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.521608 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.521698 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.521909 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.522001 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.522206 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.522302 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.522509 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.522599 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.522808 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.522899 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.523107 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.523205 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.523401 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.523484 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.523696 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.523779 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.524085 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.524204 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.524387 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.524634 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.524727 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.525055 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.525349 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.525437 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.525650 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.525826 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.525952 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.526255 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.526347 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.526594 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.526679 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.526894 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.526978 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.527249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.527351 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.527551 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.527636 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.527863 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.527948 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.528168 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.528253 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.528475 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.528566 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.528782 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.528867 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.529115 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.529202 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.529417 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.529511 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.529733 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.529817 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.530040 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.530126 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.530349 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.530434 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.530649 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.530733 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.530949 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.531081 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.531252 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.531346 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.531552 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.531645 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.531855 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.531939 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.532154 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.532236 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.532470 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.532563 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.532785 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.532909 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.533111 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.533204 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.533416 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.533510 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.533723 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.533866 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.534026 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.534170 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.534331 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.534474 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.534634 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.534789 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.534941 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.535104 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.535249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.535420 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.535556 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.535721 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.535865 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.536028 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.536173 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.536329 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.536473 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.536643 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.536776 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.536986 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.537111 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.537303 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.537425 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.537611 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.537717 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.537911 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.538025 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.538228 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.538356 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.538548 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.538634 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.538855 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.538941 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.539170 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.539255 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.539475 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.540096 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.540420 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.540505 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.540727 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.540812 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.541058 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.541187 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.541362 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.541455 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.541663 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.541746 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.541963 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.542048 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.542267 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.542352 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.542565 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.542648 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.542863 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.542954 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.543178 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.543263 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.543478 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.543580 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.543783 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.543867 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.544089 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.544185 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.544403 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.544513 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.544688 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.544778 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.545014 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.545115 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.545332 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.545416 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.545628 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.545713 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.545932 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.546025 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.546233 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.546318 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.546545 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.546628 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.546844 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.546937 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.547146 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.547230 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.547463 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.547546 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.547764 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.547850 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.548060 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.548151 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.548356 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.548522 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.548652 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.548828 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.549009 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.549157 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.549309 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.549481 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.549620 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.549802 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.549931 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.550121 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.550252 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.550423 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.550555 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.550732 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.550882 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.551037 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.551204 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.551356 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.551511 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.551676 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.551821 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.551982 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.552137 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.552294 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.552435 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.552595 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.552732 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.552939 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.553062 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.553262 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.553356 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.553573 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.553664 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.553890 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.553975 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.554218 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.554303 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.554514 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.554601 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.554811 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.554904 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.555108 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.555276 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.555959 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.556093 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.556260 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.556483 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.556570 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.556788 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.556893 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.557121 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.557208 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.557424 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.557510 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.557728 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.557822 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.558045 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.558137 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.558347 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.558433 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.558657 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.558750 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.558964 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.559063 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.559271 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.559363 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.559576 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.559661 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.559877 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.560011 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.560192 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.560285 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.560489 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.560580 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.560801 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.560921 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.561138 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.561224 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.561446 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.561538 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.561755 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.561849 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.562053 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.562137 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.562359 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.562441 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.562661 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.562747 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.562959 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.563051 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.563258 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.563351 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.563559 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.563645 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.563899 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.564073 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.564201 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.564395 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.564517 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.564702 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.564843 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.565033 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.565190 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.565340 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.565498 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.565647 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.565828 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.565955 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.566152 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.566245 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.566464 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.566549 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.566778 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.566862 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.567101 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.567260 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.567403 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.567488 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.567703 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.567795 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.568009 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.568106 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.568309 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.568395 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.568611 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.568695 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.568974 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.569064 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.569284 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.569368 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.569586 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.569725 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.569886 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.569973 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.570187 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.570274 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.570506 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.570597 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.570838 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.570961 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.571190 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.571395 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.571539 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.571793 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.571963 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.572100 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.572410 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.572495 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.572718 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.572812 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.573051 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.573157 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.573359 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.573445 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.573668 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.573761 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.573977 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.574071 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.574295 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.574379 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.574625 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.574720 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.574939 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.575024 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.575249 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.575402 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.575558 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.575648 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.575870 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.575960 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.576183 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.576382 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.576498 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.576693 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.576815 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.577046 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.577154 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.577371 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.577468 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.577690 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.577776 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.578000 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.578085 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.578309 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.578403 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.578631 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.578755 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.578932 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.579016 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.579231 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.579461 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.579546 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.579791 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.579876 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.580105 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.580204 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.580411 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.580495 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.580710 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.580801 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.581032 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.581132 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.581341 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.581427 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.581641 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.581724 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.581947 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.582162 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.582246 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.582502 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.582586 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.582810 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.582903 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.583129 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.583213 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.583446 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.583529 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.583754 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.583846 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.584055 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.584139 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.584371 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.584454 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.584670 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.584757 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.584994 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.585083 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.585307 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.585400 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.585610 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.585704 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.585907 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.585993 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.586204 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.586288 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.587028 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.587145 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.587329 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.587423 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.587655 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.587748 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.587967 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.588053 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.588279 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.588371 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.588588 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.588683 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.588918 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.589005 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.589224 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.589311 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.589525 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.589619 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.589834 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.589918 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.590134 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.590217 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.590433 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.590519 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.590749 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.590844 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.591033 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.591117 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.591341 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.591427 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.591639 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.591730 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.591942 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.592177 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.592274 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.592495 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.592583 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.592821 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.592924 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.593152 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.593253 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.593480 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.593564 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.593797 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.593881 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.594093 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.594178 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.594393 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.594477 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.594702 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.594785 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.595003 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.595089 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.595312 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.595396 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.595616 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.595699 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.595914 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.596187 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.596272 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.596526 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.596618 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.596827 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.596954 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.597167 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.597378 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.597470 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.597713 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.597986 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.598081 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.598326 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.598411 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.598640 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.598769 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.598944 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.599079 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.599244 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.599351 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.599544 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.599636 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.599858 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.599942 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.600162 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.600297 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.600468 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.600555 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.600768 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.600854 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.601096 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.601182 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.601397 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.601494 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.601695 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.601779 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.601994 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.602102 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.602976 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.603080 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.603315 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.603399 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.603624 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.603715 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.603932 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.604030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.604237 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.604321 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.604543 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.604627 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.604850 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.604990 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.605176 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.605273 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.605479 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.605563 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.605790 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.605885 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.606092 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.606176 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.606392 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.606476 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.606695 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.606780 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.606993 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.607075 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.607294 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.607378 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.607593 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.607678 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.607898 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.607982 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.608201 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.608298 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.608506 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.608590 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.608803 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.608905 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.609133 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.609242 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.609480 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.609566 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.609802 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.609886 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.610112 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.610206 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.610413 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.610497 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.610725 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.610809 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.611030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.611115 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.611332 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.611415 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.611645 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.611730 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.611950 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.612036 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.612271 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.612354 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.612587 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.612677 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.612927 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.613139 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.613246 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.613470 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.613566 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.613789 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.613882 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.614109 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.614194 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.614411 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.614494 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.614721 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.614812 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.615020 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.615110 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.615313 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.615398 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.615607 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.615692 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.615908 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.615998 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.616204 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.616288 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.616502 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.616597 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.616799 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.616897 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.617121 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.617218 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.617422 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.617513 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.617747 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.617844 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.618043 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.618262 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.618445 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.618563 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.618649 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.618872 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.618957 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.619182 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.619301 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.619483 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.619597 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.619777 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.619897 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.620071 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.620185 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.620365 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.620462 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.620663 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.620760 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.620977 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.621081 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.621300 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.621388 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.621623 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.621725 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.621931 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.622019 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.622259 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.622345 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.622546 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.622649 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.622849 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.622933 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.623148 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.623235 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.623460 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.623568 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.623767 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.623855 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.624068 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.624153 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.624417 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.624516 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.624694 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.624789 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.625022 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.625112 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.625326 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.625415 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.625635 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.625747 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.625936 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.626023 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.626236 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.626323 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.626535 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.626620 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.626855 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.626949 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.627173 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.627267 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.627471 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.627556 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.627793 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.627895 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.628104 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.628197 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.628415 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.628499 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.628714 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.628807 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.629038 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.629126 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.629340 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.629426 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.629647 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.629734 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.629947 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.630031 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.630261 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.630368 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.630560 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.630666 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.630858 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.630955 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.631162 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.631258 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.631461 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.631558 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.631759 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.631856 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.632059 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.632165 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.632359 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.632461 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.632662 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.632768 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.632985 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.633163 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.633328 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.633426 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.633663 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.633760 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.633964 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.634061 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.634266 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.634381 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.634566 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.634693 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.634872 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.635001 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.635173 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.635303 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.635532 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.635633 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 00:18:38.635835 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.636133 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.636432 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.636758 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.637111 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.637453 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.637949 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.638429 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.638924 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.639407 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.639903 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.640398 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.640910 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.641383 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.641891 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.642369 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.642847 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.643329 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.643804 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.644308 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.644817 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.645386 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.646192 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.646578 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.647072 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.647573 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.648067 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.648553 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.649580 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.650120 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.650584 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.651066 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.651555 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.652038 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.652519 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.653046 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.653535 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.654037 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.654538 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.655018 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.655516 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.656018 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.656546 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.657054 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.657586 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.658086 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.658571 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.659054 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.659526 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:38.659897 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 00:18:38.697954 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO dbcounter [None req-bdbd2bc1-dc13-4d91-a491-9705bfe7be7d None None] Registered counter for database nova_api Jun 16 00:18:38.718439 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_db.sqlalchemy.engines [None req-bdbd2bc1-dc13-4d91-a491-9705bfe7be7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:18:38.725019 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG dbcounter [-] [109459] Writer thread running {{(pid=109459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:18:38.744903 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO dbcounter [None req-ee1892ef-55be-485f-b1ba-68806769c93b None None] Registered counter for database nova_api Jun 16 00:18:38.769401 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG oslo_db.sqlalchemy.engines [None req-ee1892ef-55be-485f-b1ba-68806769c93b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109460) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:18:38.778582 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG dbcounter [-] [109460] Writer thread running {{(pid=109460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:18:38.783885 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.context [None req-bdbd2bc1-dc13-4d91-a491-9705bfe7be7d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1da0db6-963b-492e-ab04-011cf8144663(cell1) {{(pid=109459) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 00:18:38.787989 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_concurrency.lockutils [None req-bdbd2bc1-dc13-4d91-a491-9705bfe7be7d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:18:38.789587 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_concurrency.lockutils [None req-bdbd2bc1-dc13-4d91-a491-9705bfe7be7d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:18:38.790417 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_concurrency.lockutils [None req-bdbd2bc1-dc13-4d91-a491-9705bfe7be7d None None] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:18:38.792384 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_concurrency.lockutils [None req-bdbd2bc1-dc13-4d91-a491-9705bfe7be7d None None] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:18:38.794356 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO dbcounter [None req-bdbd2bc1-dc13-4d91-a491-9705bfe7be7d None None] Registered counter for database nova_cell0 Jun 16 00:18:38.798528 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO dbcounter [None req-bdbd2bc1-dc13-4d91-a491-9705bfe7be7d None None] Registered counter for database nova_cell1 Jun 16 00:18:38.806264 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_db.sqlalchemy.engines [None req-bdbd2bc1-dc13-4d91-a491-9705bfe7be7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:18:38.808798 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_db.sqlalchemy.engines [None req-bdbd2bc1-dc13-4d91-a491-9705bfe7be7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:18:38.812866 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG dbcounter [-] [109459] Writer thread running {{(pid=109459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:18:38.815899 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG dbcounter [-] [109459] Writer thread running {{(pid=109459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:18:38.837900 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.context [None req-ee1892ef-55be-485f-b1ba-68806769c93b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1da0db6-963b-492e-ab04-011cf8144663(cell1) {{(pid=109460) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 00:18:38.842026 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG oslo_concurrency.lockutils [None req-ee1892ef-55be-485f-b1ba-68806769c93b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:18:38.843585 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG oslo_concurrency.lockutils [None req-ee1892ef-55be-485f-b1ba-68806769c93b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:18:38.844385 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG oslo_concurrency.lockutils [None req-ee1892ef-55be-485f-b1ba-68806769c93b None None] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:18:38.846420 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG oslo_concurrency.lockutils [None req-ee1892ef-55be-485f-b1ba-68806769c93b None None] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:18:38.848370 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO dbcounter [None req-ee1892ef-55be-485f-b1ba-68806769c93b None None] Registered counter for database nova_cell0 Jun 16 00:18:38.852212 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO dbcounter [None req-ee1892ef-55be-485f-b1ba-68806769c93b None None] Registered counter for database nova_cell1 Jun 16 00:18:38.859094 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG oslo_db.sqlalchemy.engines [None req-ee1892ef-55be-485f-b1ba-68806769c93b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109460) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:18:38.862479 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG oslo_db.sqlalchemy.engines [None req-ee1892ef-55be-485f-b1ba-68806769c93b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109460) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:18:38.864904 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG dbcounter [-] [109460] Writer thread running {{(pid=109460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:18:38.968024 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO dbcounter [None req-bdbd2bc1-dc13-4d91-a491-9705bfe7be7d None None] Registered counter for database nova_cell0 Jun 16 00:18:38.976543 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_db.sqlalchemy.engines [None req-bdbd2bc1-dc13-4d91-a491-9705bfe7be7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:18:38.981278 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG dbcounter [-] [109459] Writer thread running {{(pid=109459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:18:39.012419 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG dbcounter [-] [109460] Writer thread running {{(pid=109460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:18:39.021568 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO dbcounter [None req-ee1892ef-55be-485f-b1ba-68806769c93b None None] Registered counter for database nova_cell0 Jun 16 00:18:39.030334 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG oslo_db.sqlalchemy.engines [None req-ee1892ef-55be-485f-b1ba-68806769c93b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109460) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:18:39.034540 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG dbcounter [-] [109460] Writer thread running {{(pid=109460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:18:39.333375 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: WARNING keystonemiddleware.auth_token [None req-bdbd2bc1-dc13-4d91-a491-9705bfe7be7d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:18:39.341166 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: WARNING keystonemiddleware.auth_token [None req-bdbd2bc1-dc13-4d91-a491-9705bfe7be7d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:18:39.382128 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: WARNING keystonemiddleware.auth_token [None req-ee1892ef-55be-485f-b1ba-68806769c93b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:18:39.389329 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: WARNING keystonemiddleware.auth_token [None req-ee1892ef-55be-485f-b1ba-68806769c93b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:18:39.685989 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: WARNING keystonemiddleware.auth_token [None req-bdbd2bc1-dc13-4d91-a491-9705bfe7be7d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:18:39.691855 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: WARNING keystonemiddleware.auth_token [None req-bdbd2bc1-dc13-4d91-a491-9705bfe7be7d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:18:39.697818 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558cfe28e9c0 pid: 109459 (default app) Jun 16 00:18:39.699900 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-bdbd2bc1-dc13-4d91-a491-9705bfe7be7d None None] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:18:39.701123 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-bdbd2bc1-dc13-4d91-a491-9705bfe7be7d None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001757 Jun 16 00:18:39.701540 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Thu Jun 16 00:18:39 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:18:39.756190 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: WARNING keystonemiddleware.auth_token [None req-ee1892ef-55be-485f-b1ba-68806769c93b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:18:39.765196 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: WARNING keystonemiddleware.auth_token [None req-ee1892ef-55be-485f-b1ba-68806769c93b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:18:39.774754 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558cfe28e9c0 pid: 109460 (default app) Jun 16 00:19:56.553343 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-bdbd2bc1-dc13-4d91-a491-9705bfe7be7d None None] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:56.555058 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-bdbd2bc1-dc13-4d91-a491-9705bfe7be7d None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002207 Jun 16 00:19:56.558456 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 930 bytes} [Thu Jun 16 00:19:56 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:19:56.574258 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG dbcounter [-] [109460] Writing DB stats nova_api:SELECT=3 {{(pid=109460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:56.576078 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG dbcounter [-] [109460] Writing DB stats nova_cell0:SELECT=3 {{(pid=109460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:56.576948 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG dbcounter [-] [109460] Writing DB stats nova_cell1:SELECT=3 {{(pid=109460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:56.578114 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG dbcounter [-] [109460] Writing DB stats nova_cell0:SELECT=3 {{(pid=109460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:57.039382 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-850b96fa-5fbb-4b2a-9fa2-52857748b6a7 admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:57.069754 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-850b96fa-5fbb-4b2a-9fa2-52857748b6a7 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.506164 Jun 16 00:19:57.070653 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1291 bytes} [Thu Jun 16 00:19:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:59.301232 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-bdbd2bc1-dc13-4d91-a491-9705bfe7be7d None None] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:59.302240 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-bdbd2bc1-dc13-4d91-a491-9705bfe7be7d None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001632 Jun 16 00:19:59.302630 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 930 bytes} [Thu Jun 16 00:19:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:19:59.373051 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-c9ee8acc-d0e7-49ba-80e1-12bb24f31db8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "ram": 256, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "c1", "name": "cirros256", "swap": 0}} {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:19:59.391539 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:19:59.391539 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: warnings.warn(msg) Jun 16 00:19:59.421814 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-c9ee8acc-d0e7-49ba-80e1-12bb24f31db8 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.113274 Jun 16 00:19:59.422586 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1282 bytes} [Thu Jun 16 00:19:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:19:59.435961 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG dbcounter [-] [109459] Writing DB stats nova_api:SELECT=3 {{(pid=109459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:59.437498 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG dbcounter [-] [109459] Writing DB stats nova_cell1:SELECT=3 {{(pid=109459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:59.438802 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG dbcounter [-] [109459] Writing DB stats nova_cell0:SELECT=3 {{(pid=109459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:59.439882 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG dbcounter [-] [109459] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:59.664732 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-35ec7345-1760-4554-986f-0e3bdb2374a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:19:59.667276 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:19:59.667276 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: warnings.warn(msg) Jun 16 00:19:59.729157 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-35ec7345-1760-4554-986f-0e3bdb2374a3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.298672 Jun 16 00:19:59.729812 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1335 bytes} [Thu Jun 16 00:19:59 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:01.900292 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-c9ee8acc-d0e7-49ba-80e1-12bb24f31db8 admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:01.901354 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-c9ee8acc-d0e7-49ba-80e1-12bb24f31db8 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jun 16 00:20:01.901771 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 930 bytes} [Thu Jun 16 00:20:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:02.017773 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-6d21f733-5857-47d1-bca5-48a61243ded3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "vcpus": 1, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "id": "d1", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:02.036370 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:20:02.036370 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: warnings.warn(msg) Jun 16 00:20:02.056253 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-6d21f733-5857-47d1-bca5-48a61243ded3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.148491 Jun 16 00:20:02.056812 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1282 bytes} [Thu Jun 16 00:20:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 00:20:02.072150 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-4db69025-2be6-4949-a9a8-7ff943aff3aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:02.073777 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:20:02.073777 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: warnings.warn(msg) Jun 16 00:20:02.126299 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-4db69025-2be6-4949-a9a8-7ff943aff3aa admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.061277 Jun 16 00:20:02.126779 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1335 bytes} [Thu Jun 16 00:20:02 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:20:04.337736 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-6d21f733-5857-47d1-bca5-48a61243ded3 admin admin] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:04.338756 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-6d21f733-5857-47d1-bca5-48a61243ded3 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jun 16 00:20:04.339428 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 930 bytes} [Thu Jun 16 00:20:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:04.402657 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-17e03143-4880-4ffe-872d-cd3f6d729f90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "name": "ds1G", "ram": 1024, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:04.421978 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-17e03143-4880-4ffe-872d-cd3f6d729f90 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076759 Jun 16 00:20:04.422546 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1282 bytes} [Thu Jun 16 00:20:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 00:20:04.435020 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-b3f62f8c-2876-49ae-9f60-f9df9e8bf38d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:04.460452 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-b3f62f8c-2876-49ae-9f60-f9df9e8bf38d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029217 Jun 16 00:20:04.461362 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1335 bytes} [Thu Jun 16 00:20:04 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:20:06.661336 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-17e03143-4880-4ffe-872d-cd3f6d729f90 admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:06.662339 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-17e03143-4880-4ffe-872d-cd3f6d729f90 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jun 16 00:20:06.662739 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 930 bytes} [Thu Jun 16 00:20:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:06.720898 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-172a91ca-41b1-4ef3-a394-2301d6a125f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "swap": 0}} {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:06.740036 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-172a91ca-41b1-4ef3-a394-2301d6a125f9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071762 Jun 16 00:20:06.740590 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1282 bytes} [Thu Jun 16 00:20:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:20:06.752318 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-56b09aa5-813e-4d67-9332-f1afdf1b3ca6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:06.774597 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-56b09aa5-813e-4d67-9332-f1afdf1b3ca6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025935 Jun 16 00:20:06.775181 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1335 bytes} [Thu Jun 16 00:20:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:09.016941 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-172a91ca-41b1-4ef3-a394-2301d6a125f9 admin admin] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:09.017958 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-172a91ca-41b1-4ef3-a394-2301d6a125f9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jun 16 00:20:09.019024 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 930 bytes} [Thu Jun 16 00:20:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:09.080466 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-31b71367-36ae-476c-aae8-0a52682da83d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "ds4G", "disk": 20, "id": "d4", "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0}} {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:09.100432 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-31b71367-36ae-476c-aae8-0a52682da83d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075607 Jun 16 00:20:09.101043 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1282 bytes} [Thu Jun 16 00:20:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 00:20:09.113835 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-9c4dfb1a-e8d4-4359-85f2-db2d7e703a95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:09.138577 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-9c4dfb1a-e8d4-4359-85f2-db2d7e703a95 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028973 Jun 16 00:20:09.139559 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1335 bytes} [Thu Jun 16 00:20:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:11.329293 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-31b71367-36ae-476c-aae8-0a52682da83d admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:11.330308 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-31b71367-36ae-476c-aae8-0a52682da83d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 16 00:20:11.331447 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 930 bytes} [Thu Jun 16 00:20:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:11.390989 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-bd9266bb-ea22-44bb-8b69-3407dbdc3df3 admin admin] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:11.415751 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-bd9266bb-ea22-44bb-8b69-3407dbdc3df3 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078262 Jun 16 00:20:11.416307 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1291 bytes} [Thu Jun 16 00:20:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:20:13.673471 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-31b71367-36ae-476c-aae8-0a52682da83d admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:13.675069 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-31b71367-36ae-476c-aae8-0a52682da83d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Jun 16 00:20:13.675475 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 930 bytes} [Thu Jun 16 00:20:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:13.751273 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-015914ce-b40f-4620-ba16-60c634e5c668 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "disk": 1, "id": "1"}} {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:13.769999 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-015914ce-b40f-4620-ba16-60c634e5c668 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.088785 Jun 16 00:20:13.770564 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1282 bytes} [Thu Jun 16 00:20:13 2022] POST /compute/v2.1/flavors => generated 402 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 00:20:13.789119 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-310a57e3-3263-4c57-8e33-42a295566a83 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:13.821697 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-310a57e3-3263-4c57-8e33-42a295566a83 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038986 Jun 16 00:20:13.822667 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1332 bytes} [Thu Jun 16 00:20:13 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:16.490095 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-015914ce-b40f-4620-ba16-60c634e5c668 admin admin] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:16.491110 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-015914ce-b40f-4620-ba16-60c634e5c668 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 16 00:20:16.491522 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 930 bytes} [Thu Jun 16 00:20:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:16.563436 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-62526218-c377-4997-b7bf-d51e757245f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "m1.small", "vcpus": 1, "ram": 2048, "id": "2"}} {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:16.583062 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-62526218-c377-4997-b7bf-d51e757245f1 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.085543 Jun 16 00:20:16.583843 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1282 bytes} [Thu Jun 16 00:20:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:20:16.596344 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-afef0468-bcc9-4004-b22f-fc890c44da4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:16.620176 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-afef0468-bcc9-4004-b22f-fc890c44da4d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027993 Jun 16 00:20:16.620758 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1332 bytes} [Thu Jun 16 00:20:16 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:18.829273 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-62526218-c377-4997-b7bf-d51e757245f1 admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:18.831025 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-62526218-c377-4997-b7bf-d51e757245f1 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jun 16 00:20:18.831422 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 930 bytes} [Thu Jun 16 00:20:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:18.895575 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-6873ce6f-aa1c-4336-821f-0c4d97f0df48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "m1.medium", "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "id": "3", "disk": 40}} {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:18.912667 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-6873ce6f-aa1c-4336-821f-0c4d97f0df48 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.075355 Jun 16 00:20:18.913259 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1282 bytes} [Thu Jun 16 00:20:18 2022] POST /compute/v2.1/flavors => generated 406 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 00:20:18.925124 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-6805c2c2-d527-4695-bda9-eec664238f25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:18.948218 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-6805c2c2-d527-4695-bda9-eec664238f25 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026858 Jun 16 00:20:18.958820 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1332 bytes} [Thu Jun 16 00:20:18 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:21.128646 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-6873ce6f-aa1c-4336-821f-0c4d97f0df48 admin admin] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:21.129687 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-6873ce6f-aa1c-4336-821f-0c4d97f0df48 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 16 00:20:21.130087 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 930 bytes} [Thu Jun 16 00:20:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:20:21.189248 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-3624ab99-3503-4e26-8b3e-46392604257c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "id": "4", "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "os-flavor-access:is_public": true}} {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:21.208627 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-3624ab99-3503-4e26-8b3e-46392604257c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072787 Jun 16 00:20:21.210084 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1282 bytes} [Thu Jun 16 00:20:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 00:20:21.222757 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-174099d5-0e19-4e41-8f2f-4d4a132b8c40 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:21.245312 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-174099d5-0e19-4e41-8f2f-4d4a132b8c40 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026723 Jun 16 00:20:21.245936 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1332 bytes} [Thu Jun 16 00:20:21 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:20:23.458857 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-3624ab99-3503-4e26-8b3e-46392604257c admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:23.460529 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-3624ab99-3503-4e26-8b3e-46392604257c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002132 Jun 16 00:20:23.464741 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 930 bytes} [Thu Jun 16 00:20:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:23.524957 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-b1930f22-a34e-4853-8e51-07d3d8e7bccb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "vcpus": 8, "swap": 0, "id": "5", "rxtx_factor": 1.0, "disk": 160}} {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:23.544003 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-b1930f22-a34e-4853-8e51-07d3d8e7bccb admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077245 Jun 16 00:20:23.544996 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1282 bytes} [Thu Jun 16 00:20:23 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:20:23.557051 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-a2f661e8-3f26-4d61-ba67-33e856c534c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:23.590846 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-a2f661e8-3f26-4d61-ba67-33e856c534c4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037404 Jun 16 00:20:23.591596 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1332 bytes} [Thu Jun 16 00:20:23 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:20:47.698723 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-b1930f22-a34e-4853-8e51-07d3d8e7bccb admin admin] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:47.699731 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-b1930f22-a34e-4853-8e51-07d3d8e7bccb admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 16 00:20:47.700124 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 930 bytes} [Thu Jun 16 00:20:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:47.710541 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG dbcounter [-] [109460] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:47.758767 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-37bda15d-bc21-4536-b352-417c10d0fc2b admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:47.775502 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-37bda15d-bc21-4536-b352-417c10d0fc2b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069503 Jun 16 00:20:47.776039 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1291 bytes} [Thu Jun 16 00:20:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:20:48.760061 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-b1930f22-a34e-4853-8e51-07d3d8e7bccb admin admin] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:48.761097 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-b1930f22-a34e-4853-8e51-07d3d8e7bccb admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 16 00:20:48.761497 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Jun 16 00:20:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:48.968066 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-ef9b8b32-f142-4380-8c2c-a0030b769240 admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:48.974381 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.wsgi [None req-ef9b8b32-f142-4380-8c2c-a0030b769240 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 00:20:48.977624 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-ef9b8b32-f142-4380-8c2c-a0030b769240 admin admin] Request method failure captured: Jun 16 00:20:48.977624 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 00:20:48.977624 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: Accept: application/json Jun 16 00:20:48.977624 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: Accept-Encoding: gzip, deflate Jun 16 00:20:48.977624 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: Connection: keep-alive Jun 16 00:20:48.977624 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: Content-Length: 0 Jun 16 00:20:48.977624 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: Host: 10.222.0.23 Jun 16 00:20:48.977624 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: Openstack-Api-Version: compute 2.90 Jun 16 00:20:48.977624 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: Openstack-System-Scope: None Jun 16 00:20:48.977624 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: User-Agent: python-novaclient Jun 16 00:20:48.977624 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Auth-Token: gAAAAABiqndgHxYy5ekM2k0eaSAtgaUZ6OmvXxd6WLKWYu1PGHh38cRnRxwv3PrDmx0nCyUaK2OcutpOwJvirl3x5Osjrzn-ShfZzNLZJ2ZNrEQER4qKDlhnllEpkweFmN9JyL4EL2YfLA1yHkniQt0vwOxpRznnR8lkS8toOMhyztDr7OAR1yU Jun 16 00:20:48.977624 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Domain-Id: None Jun 16 00:20:48.977624 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Domain-Name: None Jun 16 00:20:48.977624 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Identity-Status: Confirmed Jun 16 00:20:48.977624 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Is-Admin-Project: True Jun 16 00:20:48.977624 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 00:20:48.977624 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Project-Domain-Id: default Jun 16 00:20:48.977624 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Project-Domain-Name: Default Jun 16 00:20:48.977624 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Project-Id: 3c21334330db408fb0ba251a2f04ab82 Jun 16 00:20:48.977624 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Project-Name: admin Jun 16 00:20:48.977624 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Role: member,admin,reader Jun 16 00:20:48.977624 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Roles: member,admin,reader Jun 16 00:20:48.979299 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:20:48.979299 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Tenant: admin Jun 16 00:20:48.979299 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Tenant-Id: 3c21334330db408fb0ba251a2f04ab82 Jun 16 00:20:48.979299 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Tenant-Name: admin Jun 16 00:20:48.979299 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-User: admin Jun 16 00:20:48.979299 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-User-Domain-Id: default Jun 16 00:20:48.979299 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-User-Domain-Name: Default Jun 16 00:20:48.979299 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-User-Id: bfaf1438c4804d7499ba789f509be85e Jun 16 00:20:48.979299 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-User-Name: admin Jun 16 00:20:48.979299 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: method: > Jun 16 00:20:48.979299 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: exception: Flavor 42 could not be found. Jun 16 00:20:48.979299 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: action_args: {'id': '42'} Jun 16 00:20:48.979299 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:20:48.979299 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:20:48.980470 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 00:20:48.980470 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 00:20:48.980470 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 00:20:48.980470 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 00:20:48.980470 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 00:20:48.980470 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 00:20:48.980470 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 00:20:48.980470 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 00:20:48.980470 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 00:20:48.980470 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:20:48.980470 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 00:20:48.980470 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 00:20:48.980470 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 00:20:48.980470 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Jun 16 00:20:48.980470 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:20:48.980470 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Jun 16 00:20:48.980470 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:20:48.980470 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:20:48.980470 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:20:48.981596 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:20:48.981596 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:20:48.981596 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:20:48.981596 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:20:48.981596 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 00:20:48.981596 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:20:48.981596 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 00:20:48.981596 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Jun 16 00:20:48.981596 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:20:48.981596 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Jun 16 00:20:48.981596 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:20:48.981596 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:20:48.981596 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:20:48.981596 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:20:48.981596 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:20:48.981596 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 00:20:48.981596 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Jun 16 00:20:48.981596 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-ef9b8b32-f142-4380-8c2c-a0030b769240 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:20:48.982615 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-ef9b8b32-f142-4380-8c2c-a0030b769240 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061315 Jun 16 00:20:48.982615 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Jun 16 00:20:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:48.989425 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-3649746b-5ec7-479b-92ae-1b0294779277 admin admin] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:48.992415 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG dbcounter [-] [109459] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:49.011882 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-3649746b-5ec7-479b-92ae-1b0294779277 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026882 Jun 16 00:20:49.012413 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Jun 16 00:20:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:20:49.022227 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-0d107855-13c7-4a87-96db-0be579acf816 admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:49.043525 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-0d107855-13c7-4a87-96db-0be579acf816 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025079 Jun 16 00:20:49.044050 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Jun 16 00:20:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:20:49.054009 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-b5fb33fb-4ac5-4827-8aff-1591331d8cbe admin admin] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:49.060654 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.wsgi [None req-b5fb33fb-4ac5-4827-8aff-1591331d8cbe admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 00:20:49.064007 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-b5fb33fb-4ac5-4827-8aff-1591331d8cbe admin admin] Request method failure captured: Jun 16 00:20:49.064007 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 00:20:49.064007 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: Accept: application/json Jun 16 00:20:49.064007 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: Accept-Encoding: gzip, deflate Jun 16 00:20:49.064007 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: Connection: keep-alive Jun 16 00:20:49.064007 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: Content-Length: 0 Jun 16 00:20:49.064007 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: Host: 10.222.0.23 Jun 16 00:20:49.064007 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: Openstack-Api-Version: compute 2.90 Jun 16 00:20:49.064007 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: Openstack-System-Scope: None Jun 16 00:20:49.064007 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: User-Agent: python-novaclient Jun 16 00:20:49.064007 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Auth-Token: gAAAAABiqndgHxYy5ekM2k0eaSAtgaUZ6OmvXxd6WLKWYu1PGHh38cRnRxwv3PrDmx0nCyUaK2OcutpOwJvirl3x5Osjrzn-ShfZzNLZJ2ZNrEQER4qKDlhnllEpkweFmN9JyL4EL2YfLA1yHkniQt0vwOxpRznnR8lkS8toOMhyztDr7OAR1yU Jun 16 00:20:49.064007 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Domain-Id: None Jun 16 00:20:49.064007 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Domain-Name: None Jun 16 00:20:49.064007 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Identity-Status: Confirmed Jun 16 00:20:49.064007 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Is-Admin-Project: True Jun 16 00:20:49.064007 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 00:20:49.064007 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Project-Domain-Id: default Jun 16 00:20:49.064007 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Project-Domain-Name: Default Jun 16 00:20:49.064007 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Project-Id: 3c21334330db408fb0ba251a2f04ab82 Jun 16 00:20:49.064007 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Project-Name: admin Jun 16 00:20:49.064007 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Role: member,admin,reader Jun 16 00:20:49.064007 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Roles: member,admin,reader Jun 16 00:20:49.066409 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:20:49.066409 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Tenant: admin Jun 16 00:20:49.066409 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Tenant-Id: 3c21334330db408fb0ba251a2f04ab82 Jun 16 00:20:49.066409 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Tenant-Name: admin Jun 16 00:20:49.066409 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-User: admin Jun 16 00:20:49.066409 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-User-Domain-Id: default Jun 16 00:20:49.066409 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-User-Domain-Name: Default Jun 16 00:20:49.066409 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-User-Id: bfaf1438c4804d7499ba789f509be85e Jun 16 00:20:49.066409 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-User-Name: admin Jun 16 00:20:49.066409 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: method: > Jun 16 00:20:49.066409 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: exception: Flavor 42 could not be found. Jun 16 00:20:49.066409 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: action_args: {'id': '42'} Jun 16 00:20:49.066409 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:20:49.066409 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:20:49.067563 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 00:20:49.067563 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 00:20:49.067563 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 00:20:49.067563 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 00:20:49.067563 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 00:20:49.067563 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 00:20:49.067563 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 00:20:49.067563 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 00:20:49.067563 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 00:20:49.067563 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:20:49.067563 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 00:20:49.067563 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 00:20:49.067563 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 00:20:49.067563 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Jun 16 00:20:49.067563 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:20:49.067563 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Jun 16 00:20:49.067563 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:20:49.067563 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:20:49.067563 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:20:49.068910 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:20:49.068910 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:20:49.068910 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:20:49.068910 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:20:49.068910 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 00:20:49.068910 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:20:49.068910 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 00:20:49.068910 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Jun 16 00:20:49.068910 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:20:49.068910 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Jun 16 00:20:49.068910 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:20:49.068910 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:20:49.068910 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:20:49.068910 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:20:49.068910 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:20:49.068910 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 00:20:49.068910 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Jun 16 00:20:49.068910 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-b5fb33fb-4ac5-4827-8aff-1591331d8cbe admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:20:49.070509 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-b5fb33fb-4ac5-4827-8aff-1591331d8cbe admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014927 Jun 16 00:20:49.070509 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Jun 16 00:20:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:49.936627 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-0d107855-13c7-4a87-96db-0be579acf816 admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:49.937689 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-0d107855-13c7-4a87-96db-0be579acf816 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jun 16 00:20:49.938084 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Jun 16 00:20:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:50.128565 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-fdfbcb29-75bc-4b53-8265-1159ffb26750 admin admin] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:50.133966 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.wsgi [None req-fdfbcb29-75bc-4b53-8265-1159ffb26750 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 00:20:50.135452 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-fdfbcb29-75bc-4b53-8265-1159ffb26750 admin admin] Request method failure captured: Jun 16 00:20:50.135452 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 00:20:50.135452 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: Accept: application/json Jun 16 00:20:50.135452 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: Accept-Encoding: gzip, deflate Jun 16 00:20:50.135452 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: Connection: keep-alive Jun 16 00:20:50.135452 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: Content-Length: 0 Jun 16 00:20:50.135452 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: Host: 10.222.0.23 Jun 16 00:20:50.135452 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: Openstack-Api-Version: compute 2.90 Jun 16 00:20:50.135452 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: Openstack-System-Scope: None Jun 16 00:20:50.135452 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: User-Agent: python-novaclient Jun 16 00:20:50.135452 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Auth-Token: gAAAAABiqndhfjLhm16jlTKyKvcRQkPJ3jWuNiaXEAn0YYvYHGhJOqB3bebBDSqpqkfAuXSN0hli44FGjUIAB9o-9E0UL6xDbsGxI9GVtALlgdHyUC5asM4dCzYwJ4o-KC--bDOiyeWz7AEX_A49EAJMcB16QI9Xura0KZeK8CJgxFPZO2EOu7I Jun 16 00:20:50.135452 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Domain-Id: None Jun 16 00:20:50.135452 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Domain-Name: None Jun 16 00:20:50.135452 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Identity-Status: Confirmed Jun 16 00:20:50.135452 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Is-Admin-Project: True Jun 16 00:20:50.135452 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 00:20:50.135452 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Project-Domain-Id: default Jun 16 00:20:50.135452 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Project-Domain-Name: Default Jun 16 00:20:50.135452 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Project-Id: 3c21334330db408fb0ba251a2f04ab82 Jun 16 00:20:50.135452 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Project-Name: admin Jun 16 00:20:50.135452 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Role: member,admin,reader Jun 16 00:20:50.135452 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Roles: member,admin,reader Jun 16 00:20:50.136998 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:20:50.136998 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Tenant: admin Jun 16 00:20:50.136998 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Tenant-Id: 3c21334330db408fb0ba251a2f04ab82 Jun 16 00:20:50.136998 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Tenant-Name: admin Jun 16 00:20:50.136998 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-User: admin Jun 16 00:20:50.136998 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-User-Domain-Id: default Jun 16 00:20:50.136998 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-User-Domain-Name: Default Jun 16 00:20:50.136998 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-User-Id: bfaf1438c4804d7499ba789f509be85e Jun 16 00:20:50.136998 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-User-Name: admin Jun 16 00:20:50.136998 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: method: > Jun 16 00:20:50.136998 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: exception: Flavor 84 could not be found. Jun 16 00:20:50.136998 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: action_args: {'id': '84'} Jun 16 00:20:50.136998 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:20:50.136998 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:20:50.137964 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 00:20:50.137964 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 00:20:50.137964 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 00:20:50.137964 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 00:20:50.137964 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 00:20:50.137964 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 00:20:50.137964 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 00:20:50.137964 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 00:20:50.137964 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 00:20:50.137964 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:20:50.137964 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 00:20:50.137964 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 00:20:50.137964 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 00:20:50.137964 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Jun 16 00:20:50.137964 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:20:50.137964 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Jun 16 00:20:50.137964 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:20:50.137964 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:20:50.137964 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:20:50.139367 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:20:50.139367 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:20:50.139367 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:20:50.139367 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:20:50.139367 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 00:20:50.139367 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:20:50.139367 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 00:20:50.139367 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Jun 16 00:20:50.139367 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:20:50.139367 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Jun 16 00:20:50.139367 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:20:50.139367 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:20:50.139367 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:20:50.139367 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:20:50.139367 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:20:50.139367 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 00:20:50.139367 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Jun 16 00:20:50.139367 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-fdfbcb29-75bc-4b53-8265-1159ffb26750 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:20:50.140597 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-fdfbcb29-75bc-4b53-8265-1159ffb26750 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060908 Jun 16 00:20:50.140597 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Jun 16 00:20:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:50.147083 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-87a9292a-033e-46ce-ac18-270f73bcb478 admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:50.161111 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-87a9292a-033e-46ce-ac18-270f73bcb478 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017812 Jun 16 00:20:50.161629 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Jun 16 00:20:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:20:50.170751 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-759ab535-70ac-4684-b29e-2e13f4d14de7 admin admin] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:50.184771 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-759ab535-70ac-4684-b29e-2e13f4d14de7 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017488 Jun 16 00:20:50.185448 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Jun 16 00:20:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:20:50.195079 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-9b8149c2-3568-4018-8ea0-1ab89f8bf55c admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:50.200508 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.wsgi [None req-9b8149c2-3568-4018-8ea0-1ab89f8bf55c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 00:20:50.202030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-9b8149c2-3568-4018-8ea0-1ab89f8bf55c admin admin] Request method failure captured: Jun 16 00:20:50.202030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 00:20:50.202030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: Accept: application/json Jun 16 00:20:50.202030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: Accept-Encoding: gzip, deflate Jun 16 00:20:50.202030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: Connection: keep-alive Jun 16 00:20:50.202030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: Content-Length: 0 Jun 16 00:20:50.202030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: Host: 10.222.0.23 Jun 16 00:20:50.202030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: Openstack-Api-Version: compute 2.90 Jun 16 00:20:50.202030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: Openstack-System-Scope: None Jun 16 00:20:50.202030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: User-Agent: python-novaclient Jun 16 00:20:50.202030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Auth-Token: gAAAAABiqndhfjLhm16jlTKyKvcRQkPJ3jWuNiaXEAn0YYvYHGhJOqB3bebBDSqpqkfAuXSN0hli44FGjUIAB9o-9E0UL6xDbsGxI9GVtALlgdHyUC5asM4dCzYwJ4o-KC--bDOiyeWz7AEX_A49EAJMcB16QI9Xura0KZeK8CJgxFPZO2EOu7I Jun 16 00:20:50.202030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Domain-Id: None Jun 16 00:20:50.202030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Domain-Name: None Jun 16 00:20:50.202030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Identity-Status: Confirmed Jun 16 00:20:50.202030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Is-Admin-Project: True Jun 16 00:20:50.202030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 00:20:50.202030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Project-Domain-Id: default Jun 16 00:20:50.202030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Project-Domain-Name: Default Jun 16 00:20:50.202030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Project-Id: 3c21334330db408fb0ba251a2f04ab82 Jun 16 00:20:50.202030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Project-Name: admin Jun 16 00:20:50.202030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Role: member,admin,reader Jun 16 00:20:50.202030 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Roles: member,admin,reader Jun 16 00:20:50.203515 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:20:50.203515 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Tenant: admin Jun 16 00:20:50.203515 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Tenant-Id: 3c21334330db408fb0ba251a2f04ab82 Jun 16 00:20:50.203515 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Tenant-Name: admin Jun 16 00:20:50.203515 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-User: admin Jun 16 00:20:50.203515 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-User-Domain-Id: default Jun 16 00:20:50.203515 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-User-Domain-Name: Default Jun 16 00:20:50.203515 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-User-Id: bfaf1438c4804d7499ba789f509be85e Jun 16 00:20:50.203515 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-User-Name: admin Jun 16 00:20:50.203515 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: method: > Jun 16 00:20:50.203515 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: exception: Flavor 84 could not be found. Jun 16 00:20:50.203515 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: action_args: {'id': '84'} Jun 16 00:20:50.203515 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:20:50.203515 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:20:50.205096 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 00:20:50.205096 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 00:20:50.205096 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 00:20:50.205096 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 00:20:50.205096 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 00:20:50.205096 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 00:20:50.205096 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 00:20:50.205096 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 00:20:50.205096 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 00:20:50.205096 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:20:50.205096 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 00:20:50.205096 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 00:20:50.205096 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 00:20:50.205096 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Jun 16 00:20:50.205096 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:20:50.205096 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Jun 16 00:20:50.205096 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:20:50.205096 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:20:50.205096 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:20:50.206571 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:20:50.206571 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:20:50.206571 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:20:50.206571 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:20:50.206571 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 00:20:50.206571 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:20:50.206571 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 00:20:50.206571 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Jun 16 00:20:50.206571 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:20:50.206571 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Jun 16 00:20:50.206571 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:20:50.206571 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:20:50.206571 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:20:50.206571 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:20:50.206571 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:20:50.206571 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 00:20:50.206571 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Jun 16 00:20:50.206571 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-9b8149c2-3568-4018-8ea0-1ab89f8bf55c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:20:50.207805 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-9b8149c2-3568-4018-8ea0-1ab89f8bf55c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011922 Jun 16 00:20:50.207805 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Jun 16 00:20:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:51.066325 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-759ab535-70ac-4684-b29e-2e13f4d14de7 admin admin] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:51.067335 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-759ab535-70ac-4684-b29e-2e13f4d14de7 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 16 00:20:51.067753 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Jun 16 00:20:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:51.258781 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-b354745c-51d7-4646-b176-cd1f648a156f admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:51.265786 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.wsgi [None req-b354745c-51d7-4646-b176-cd1f648a156f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 00:20:51.267249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-b354745c-51d7-4646-b176-cd1f648a156f admin admin] Request method failure captured: Jun 16 00:20:51.267249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 00:20:51.267249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: Accept: application/json Jun 16 00:20:51.267249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: Accept-Encoding: gzip, deflate Jun 16 00:20:51.267249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: Connection: keep-alive Jun 16 00:20:51.267249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: Content-Length: 0 Jun 16 00:20:51.267249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: Host: 10.222.0.23 Jun 16 00:20:51.267249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: Openstack-Api-Version: compute 2.90 Jun 16 00:20:51.267249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: Openstack-System-Scope: None Jun 16 00:20:51.267249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: User-Agent: python-novaclient Jun 16 00:20:51.267249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Auth-Token: gAAAAABiqndj8_4JOb6QRA5X9ar_0Hb8HPKDKF0VJxb4tELz1Gx3mqBhSSwVqIOHdZjl7OIbFwwIL9x4KmMnyAgK1t0kTUzTUuPpRl3r7hIXgLMQ6Bvh0fjt9EbVO58m6VWO2rs1MhZ9Nz7Xj5enFIOwvaimRmC8LjIF5HStcvR-uFjX_ua8MQA Jun 16 00:20:51.267249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Domain-Id: None Jun 16 00:20:51.267249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Domain-Name: None Jun 16 00:20:51.267249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Identity-Status: Confirmed Jun 16 00:20:51.267249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Is-Admin-Project: True Jun 16 00:20:51.267249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 00:20:51.267249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Project-Domain-Id: default Jun 16 00:20:51.267249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Project-Domain-Name: Default Jun 16 00:20:51.267249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Project-Id: 3c21334330db408fb0ba251a2f04ab82 Jun 16 00:20:51.267249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Project-Name: admin Jun 16 00:20:51.267249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Role: member,admin,reader Jun 16 00:20:51.267249 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Roles: member,admin,reader Jun 16 00:20:51.269074 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:20:51.269074 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Tenant: admin Jun 16 00:20:51.269074 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Tenant-Id: 3c21334330db408fb0ba251a2f04ab82 Jun 16 00:20:51.269074 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-Tenant-Name: admin Jun 16 00:20:51.269074 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-User: admin Jun 16 00:20:51.269074 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-User-Domain-Id: default Jun 16 00:20:51.269074 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-User-Domain-Name: Default Jun 16 00:20:51.269074 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-User-Id: bfaf1438c4804d7499ba789f509be85e Jun 16 00:20:51.269074 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: X-User-Name: admin Jun 16 00:20:51.269074 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: method: > Jun 16 00:20:51.269074 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: exception: Flavor 451 could not be found. Jun 16 00:20:51.269074 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: action_args: {'id': '451'} Jun 16 00:20:51.269074 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:20:51.269074 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:20:51.270039 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 00:20:51.270039 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 00:20:51.270039 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 00:20:51.270039 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 00:20:51.270039 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 00:20:51.270039 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 00:20:51.270039 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 00:20:51.270039 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 00:20:51.270039 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 00:20:51.270039 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:20:51.270039 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 00:20:51.270039 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 00:20:51.270039 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 00:20:51.270039 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Jun 16 00:20:51.270039 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:20:51.270039 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Jun 16 00:20:51.270039 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:20:51.270039 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:20:51.270039 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:20:51.271449 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:20:51.271449 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:20:51.271449 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:20:51.271449 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:20:51.271449 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 00:20:51.271449 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:20:51.271449 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 00:20:51.271449 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Jun 16 00:20:51.271449 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:20:51.271449 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Jun 16 00:20:51.271449 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:20:51.271449 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:20:51.271449 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:20:51.271449 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:20:51.271449 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:20:51.271449 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 00:20:51.271449 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: ERROR nova.api.openstack.wsgi Jun 16 00:20:51.271449 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-b354745c-51d7-4646-b176-cd1f648a156f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:20:51.272703 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-b354745c-51d7-4646-b176-cd1f648a156f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061682 Jun 16 00:20:51.272703 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Jun 16 00:20:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:51.278617 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-510709a5-ea3c-45be-bef5-d083bd4de8fb admin admin] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:51.294347 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-510709a5-ea3c-45be-bef5-d083bd4de8fb admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019525 Jun 16 00:20:51.294871 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Jun 16 00:20:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:20:51.305165 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-6fcca715-ebe5-4e76-87c7-11010c1a66df admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:51.318600 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-6fcca715-ebe5-4e76-87c7-11010c1a66df admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017166 Jun 16 00:20:51.319107 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Jun 16 00:20:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:20:51.328045 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-11c1a806-3de7-42a7-be68-2bbbdcf84eb8 admin admin] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:51.333939 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.wsgi [None req-11c1a806-3de7-42a7-be68-2bbbdcf84eb8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 00:20:51.335398 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-11c1a806-3de7-42a7-be68-2bbbdcf84eb8 admin admin] Request method failure captured: Jun 16 00:20:51.335398 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 00:20:51.335398 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: Accept: application/json Jun 16 00:20:51.335398 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: Accept-Encoding: gzip, deflate Jun 16 00:20:51.335398 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: Connection: keep-alive Jun 16 00:20:51.335398 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: Content-Length: 0 Jun 16 00:20:51.335398 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: Host: 10.222.0.23 Jun 16 00:20:51.335398 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: Openstack-Api-Version: compute 2.90 Jun 16 00:20:51.335398 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: Openstack-System-Scope: None Jun 16 00:20:51.335398 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: User-Agent: python-novaclient Jun 16 00:20:51.335398 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Auth-Token: gAAAAABiqndj8_4JOb6QRA5X9ar_0Hb8HPKDKF0VJxb4tELz1Gx3mqBhSSwVqIOHdZjl7OIbFwwIL9x4KmMnyAgK1t0kTUzTUuPpRl3r7hIXgLMQ6Bvh0fjt9EbVO58m6VWO2rs1MhZ9Nz7Xj5enFIOwvaimRmC8LjIF5HStcvR-uFjX_ua8MQA Jun 16 00:20:51.335398 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Domain-Id: None Jun 16 00:20:51.335398 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Domain-Name: None Jun 16 00:20:51.335398 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Identity-Status: Confirmed Jun 16 00:20:51.335398 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Is-Admin-Project: True Jun 16 00:20:51.335398 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 00:20:51.335398 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Project-Domain-Id: default Jun 16 00:20:51.335398 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Project-Domain-Name: Default Jun 16 00:20:51.335398 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Project-Id: 3c21334330db408fb0ba251a2f04ab82 Jun 16 00:20:51.335398 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Project-Name: admin Jun 16 00:20:51.335398 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Role: member,admin,reader Jun 16 00:20:51.335398 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Roles: member,admin,reader Jun 16 00:20:51.336902 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c21334330db408fb0ba251a2f04ab82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:20:51.336902 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Tenant: admin Jun 16 00:20:51.336902 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Tenant-Id: 3c21334330db408fb0ba251a2f04ab82 Jun 16 00:20:51.336902 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-Tenant-Name: admin Jun 16 00:20:51.336902 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-User: admin Jun 16 00:20:51.336902 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-User-Domain-Id: default Jun 16 00:20:51.336902 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-User-Domain-Name: Default Jun 16 00:20:51.336902 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-User-Id: bfaf1438c4804d7499ba789f509be85e Jun 16 00:20:51.336902 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: X-User-Name: admin Jun 16 00:20:51.336902 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: method: > Jun 16 00:20:51.336902 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: exception: Flavor 451 could not be found. Jun 16 00:20:51.336902 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: action_args: {'id': '451'} Jun 16 00:20:51.336902 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:20:51.336902 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:20:51.337928 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 00:20:51.337928 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 00:20:51.337928 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 00:20:51.337928 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 00:20:51.337928 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 00:20:51.337928 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 00:20:51.337928 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 00:20:51.337928 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 00:20:51.337928 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 00:20:51.337928 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:20:51.337928 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 00:20:51.337928 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 00:20:51.337928 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 00:20:51.337928 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Jun 16 00:20:51.337928 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:20:51.337928 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Jun 16 00:20:51.337928 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:20:51.337928 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:20:51.337928 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:20:51.339266 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:20:51.339266 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:20:51.339266 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:20:51.339266 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:20:51.339266 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 00:20:51.339266 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:20:51.339266 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 00:20:51.339266 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Jun 16 00:20:51.339266 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:20:51.339266 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Jun 16 00:20:51.339266 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:20:51.339266 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:20:51.339266 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:20:51.339266 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:20:51.339266 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:20:51.339266 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 00:20:51.339266 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: ERROR nova.api.openstack.wsgi Jun 16 00:20:51.339266 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-11c1a806-3de7-42a7-be68-2bbbdcf84eb8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:20:51.340663 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-11c1a806-3de7-42a7-be68-2bbbdcf84eb8 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012171 Jun 16 00:20:51.340663 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Jun 16 00:20:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:52.194522 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-6fcca715-ebe5-4e76-87c7-11010c1a66df admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:52.195542 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-6fcca715-ebe5-4e76-87c7-11010c1a66df admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jun 16 00:20:52.195924 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Jun 16 00:20:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:52.388665 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-2b171808-8aa2-4253-ac1d-e65d6b65fd47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:52.408441 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-2b171808-8aa2-4253-ac1d-e65d6b65fd47 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070098 Jun 16 00:20:52.408928 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Jun 16 00:20:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:20:53.278269 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-6fcca715-ebe5-4e76-87c7-11010c1a66df admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:53.279298 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-6fcca715-ebe5-4e76-87c7-11010c1a66df admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 16 00:20:53.279683 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Jun 16 00:20:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:53.479511 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-c06a947f-2406-4958-9baf-1c8d30f3e012 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:53.498709 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-c06a947f-2406-4958-9baf-1c8d30f3e012 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.075678 Jun 16 00:20:53.499179 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Jun 16 00:20:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:20:54.367933 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-6fcca715-ebe5-4e76-87c7-11010c1a66df admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:54.368991 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-6fcca715-ebe5-4e76-87c7-11010c1a66df admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 16 00:20:54.369381 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Jun 16 00:20:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:54.560502 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-a74ef7c8-e458-43f5-8a91-11a79e60d356 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:54.577583 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-a74ef7c8-e458-43f5-8a91-11a79e60d356 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071220 Jun 16 00:20:54.578046 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Jun 16 00:20:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:20:55.465131 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-6fcca715-ebe5-4e76-87c7-11010c1a66df admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:55.466130 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-6fcca715-ebe5-4e76-87c7-11010c1a66df admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 16 00:20:55.466513 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Jun 16 00:20:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:55.658540 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-84315edf-a9dc-4d79-bd41-c15a8194101d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:55.675884 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-84315edf-a9dc-4d79-bd41-c15a8194101d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070213 Jun 16 00:20:55.676410 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Jun 16 00:20:55 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:20:56.534445 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-6fcca715-ebe5-4e76-87c7-11010c1a66df admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:56.535445 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-6fcca715-ebe5-4e76-87c7-11010c1a66df admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Jun 16 00:20:56.535854 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Jun 16 00:20:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:56.724770 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-039ef2e5-dc5c-4bc6-b7b0-f029fb85f414 admin admin] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:56.744437 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-039ef2e5-dc5c-4bc6-b7b0-f029fb85f414 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070296 Jun 16 00:20:56.744928 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1202 bytes} [Thu Jun 16 00:20:56 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:21:45.124334 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-6fcca715-ebe5-4e76-87c7-11010c1a66df admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:21:45.125402 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-6fcca715-ebe5-4e76-87c7-11010c1a66df admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jun 16 00:21:45.125806 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 930 bytes} [Thu Jun 16 00:21:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:21:45.136156 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG dbcounter [-] [109459] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:45.185600 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-c32e34dd-a55f-43e7-8cf4-1d0691f1c4c2 admin admin] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:21:45.205485 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-c32e34dd-a55f-43e7-8cf4-1d0691f1c4c2 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073745 Jun 16 00:21:45.206025 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1291 bytes} [Thu Jun 16 00:21:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:21:45.229220 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-a2ad2019-bebd-4e00-93c6-f9452eeebf47 admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:21:45.232693 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG dbcounter [-] [109460] Writing DB stats nova_api:SELECT=14 {{(pid=109460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:45.239930 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-a2ad2019-bebd-4e00-93c6-f9452eeebf47 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014322 Jun 16 00:21:45.240489 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1282 bytes} [Thu Jun 16 00:21:45 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:21:45.255119 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-0ab8c409-0c0d-4335-ad55-afcddb48e31d admin admin] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:21:45.264103 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-0ab8c409-0c0d-4335-ad55-afcddb48e31d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013760 Jun 16 00:21:45.264617 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1285 bytes} [Thu Jun 16 00:21:45 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:21:45.277809 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-bb79bd66-b207-4806-b89f-48bfdea41b16 admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:21:45.287058 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-bb79bd66-b207-4806-b89f-48bfdea41b16 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013361 Jun 16 00:21:45.287581 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1285 bytes} [Thu Jun 16 00:21:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:21:45.299548 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-8c359a8d-5aa6-4949-a275-fd1cd73e5005 admin admin] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:21:45.307128 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-8c359a8d-5aa6-4949-a275-fd1cd73e5005 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011899 Jun 16 00:21:45.307646 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1282 bytes} [Thu Jun 16 00:21:45 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:25:00.327842 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-bb79bd66-b207-4806-b89f-48bfdea41b16 admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:25:00.328863 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-bb79bd66-b207-4806-b89f-48bfdea41b16 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 16 00:25:00.329285 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 34/69] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Jun 16 00:25:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:25:00.492789 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG dbcounter [-] [109459] Writing DB stats nova_api:SELECT=6 {{(pid=109459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:00.614458 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-5715b7a6-838b-4aec-a718-17c774dead26 admin admin] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:25:00.615701 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:25:00.615701 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: warnings.warn(msg) Jun 16 00:25:00.616960 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_concurrency.lockutils [None req-5715b7a6-838b-4aec-a718-17c774dead26 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:25:00.617400 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_concurrency.lockutils [None req-5715b7a6-838b-4aec-a718-17c774dead26 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:25:00.618171 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_concurrency.lockutils [None req-5715b7a6-838b-4aec-a718-17c774dead26 admin admin] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:25:00.618673 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_concurrency.lockutils [None req-5715b7a6-838b-4aec-a718-17c774dead26 admin admin] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:25:00.654787 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-5715b7a6-838b-4aec-a718-17c774dead26 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.163043 Jun 16 00:25:00.655355 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 36/70] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Jun 16 00:25:00 2022] GET /compute/v2.1/os-services => generated 791 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:25:01.547332 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-bb79bd66-b207-4806-b89f-48bfdea41b16 admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:25:01.548344 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-bb79bd66-b207-4806-b89f-48bfdea41b16 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jun 16 00:25:01.548734 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 35/71] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Jun 16 00:25:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:25:01.748153 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-1e49f42c-bd13-4e92-bc75-dd6078aa9289 admin admin] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:25:01.749351 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:25:01.749351 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: warnings.warn(msg) Jun 16 00:25:01.750543 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_concurrency.lockutils [None req-1e49f42c-bd13-4e92-bc75-dd6078aa9289 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:25:01.750981 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_concurrency.lockutils [None req-1e49f42c-bd13-4e92-bc75-dd6078aa9289 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:25:01.751791 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_concurrency.lockutils [None req-1e49f42c-bd13-4e92-bc75-dd6078aa9289 admin admin] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:25:01.752211 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_concurrency.lockutils [None req-1e49f42c-bd13-4e92-bc75-dd6078aa9289 admin admin] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:25:01.771683 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-1e49f42c-bd13-4e92-bc75-dd6078aa9289 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076411 Jun 16 00:25:01.772239 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 37/72] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Jun 16 00:25:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:25:13.064768 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-bb79bd66-b207-4806-b89f-48bfdea41b16 admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:25:13.065914 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-bb79bd66-b207-4806-b89f-48bfdea41b16 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Jun 16 00:25:13.066332 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 36/73] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Jun 16 00:25:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:25:13.210701 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG dbcounter [-] [109459] Writing DB stats nova_cell0:SELECT=4 {{(pid=109459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:13.211414 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG dbcounter [-] [109459] Writing DB stats nova_cell1:SELECT=4 {{(pid=109459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:13.212006 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG dbcounter [-] [109459] Writing DB stats nova_api:SELECT=8 {{(pid=109459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:13.259287 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-d1b7bf85-1de3-40d6-a37d-e15fa1ca3f7c admin admin] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:25:13.260487 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:25:13.260487 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: warnings.warn(msg) Jun 16 00:25:13.261740 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_concurrency.lockutils [None req-d1b7bf85-1de3-40d6-a37d-e15fa1ca3f7c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:25:13.262208 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_concurrency.lockutils [None req-d1b7bf85-1de3-40d6-a37d-e15fa1ca3f7c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:25:13.263018 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_concurrency.lockutils [None req-d1b7bf85-1de3-40d6-a37d-e15fa1ca3f7c admin admin] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:25:13.263443 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_concurrency.lockutils [None req-d1b7bf85-1de3-40d6-a37d-e15fa1ca3f7c admin admin] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:25:13.288259 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-d1b7bf85-1de3-40d6-a37d-e15fa1ca3f7c admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081955 Jun 16 00:25:13.288741 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 38/74] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Jun 16 00:25:13 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:25:14.154302 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: DEBUG nova.api.openstack.wsgi [None req-bb79bd66-b207-4806-b89f-48bfdea41b16 admin admin] Calling method '>' {{(pid=109460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:25:14.155837 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: INFO nova.api.openstack.requestlog [None req-bb79bd66-b207-4806-b89f-48bfdea41b16 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001947 Jun 16 00:25:14.156231 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: [pid: 109460|app: 0|req: 37/75] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Jun 16 00:25:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:25:14.347915 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG nova.api.openstack.wsgi [None req-24b06845-e6cf-4b78-8545-f5fbbaf1b539 admin admin] Calling method '>' {{(pid=109459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:25:14.349105 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:25:14.349105 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: warnings.warn(msg) Jun 16 00:25:14.350288 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_concurrency.lockutils [None req-24b06845-e6cf-4b78-8545-f5fbbaf1b539 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:25:14.350739 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_concurrency.lockutils [None req-24b06845-e6cf-4b78-8545-f5fbbaf1b539 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:25:14.351510 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_concurrency.lockutils [None req-24b06845-e6cf-4b78-8545-f5fbbaf1b539 admin admin] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:25:14.351924 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: DEBUG oslo_concurrency.lockutils [None req-24b06845-e6cf-4b78-8545-f5fbbaf1b539 admin admin] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:25:14.373697 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: INFO nova.api.openstack.requestlog [None req-24b06845-e6cf-4b78-8545-f5fbbaf1b539 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076893 Jun 16 00:25:14.374333 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: [pid: 109459|app: 0|req: 39/76] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Jun 16 00:25:14 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:26:12.716120 dv-cinder-845990-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 16 00:26:12.716677 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: Thu Jun 16 00:26:12 2022 - graceful shutdown triggered... Jun 16 00:26:12.717192 dv-cinder-845990-2-iscsi devstack@n-api.service[109460]: Gracefully killing worker 2 (pid: 109460)... Jun 16 00:26:12.717565 dv-cinder-845990-2-iscsi devstack@n-api.service[109459]: Gracefully killing worker 1 (pid: 109459)... Jun 16 00:26:13.717587 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: worker 1 buried after 1 seconds Jun 16 00:26:13.718113 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: worker 2 buried after 1 seconds Jun 16 00:26:13.718113 dv-cinder-845990-2-iscsi devstack@n-api.service[109458]: goodbye to uWSGI. Jun 16 00:26:13.719210 dv-cinder-845990-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 16 00:26:13.719751 dv-cinder-845990-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 16 00:26:13.722480 dv-cinder-845990-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 00:26:13.735538 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 00:26:13.737718 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 00:26:13 2022] *** Jun 16 00:26:13.737718 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 00:26:13.737718 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 00:26:13.737718 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: nodename: dv-cinder-845990-2-iscsi Jun 16 00:26:13.737718 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: machine: x86_64 Jun 16 00:26:13.737718 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: clock source: unix Jun 16 00:26:13.737718 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: pcre jit disabled Jun 16 00:26:13.737718 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: detected number of CPU cores: 4 Jun 16 00:26:13.737718 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: current working directory: / Jun 16 00:26:13.737718 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: detected binary path: /usr/bin/uwsgi-core Jun 16 00:26:13.737718 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: your processes number limit is 47680 Jun 16 00:26:13.738418 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: your memory page size is 4096 bytes Jun 16 00:26:13.738418 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: detected max file descriptor number: 2048 Jun 16 00:26:13.738418 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: lock engine: pthread robust mutexes Jun 16 00:26:13.738418 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: thunder lock: enabled Jun 16 00:26:13.738418 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 00:26:13.738418 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 00:26:13.784494 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: Python main interpreter initialized at 0x55916256d9c0 Jun 16 00:26:13.784494 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: python threads support enabled Jun 16 00:26:13.784494 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: your server socket listen backlog is limited to 100 connections Jun 16 00:26:13.784494 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: your mercy for graceful operations on workers is 90 seconds Jun 16 00:26:13.785006 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 00:26:13.785006 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: *** Operational MODE: preforking *** Jun 16 00:26:13.785248 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: *** uWSGI is running in multiple interpreter mode *** Jun 16 00:26:13.785248 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: spawned uWSGI master process (pid: 124213) Jun 16 00:26:13.785457 dv-cinder-845990-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 00:26:13.786059 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: spawned uWSGI worker 1 (pid: 124230, cores: 1) Jun 16 00:26:13.786403 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: spawned uWSGI worker 2 (pid: 124231, cores: 1) Jun 16 00:26:13.788987 dv-cinder-845990-2-iscsi devstack@n-api.service[124213]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 00:26:14.446075 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 00:26:14.461620 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 00:26:15.726873 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:26:15.726873 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: from cryptography.utils import int_from_bytes Jun 16 00:26:15.727359 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:26:15.727359 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: from cryptography.utils import int_from_bytes Jun 16 00:26:15.753533 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:26:15.753533 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: from cryptography.utils import int_from_bytes Jun 16 00:26:15.754042 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:26:15.754042 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: from cryptography.utils import int_from_bytes Jun 16 00:26:18.211925 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 00:26:18.212444 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 00:26:18.212694 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 00:26:18.213082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 00:26:18.213343 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 00:26:18.213736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.214083 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.215027 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.215354 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.215865 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.216185 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.216517 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.216842 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.217212 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.217477 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.217799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.218129 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845990-2-iscsi {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.218469 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.218768 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.219079 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.219400 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.219708 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.220048 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.220343 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.220760 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 00:26:18.221178 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.221277 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 00:26:18.221350 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.221563 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 00:26:18.221660 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.221897 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.222009 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 00:26:18.222153 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 00:26:18.222264 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.222534 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.222659 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.222842 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.222939 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.223155 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.223254 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.223463 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.223563 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.223786 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.223882 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.224094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.224204 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.224409 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.224555 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845990-2-iscsi {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.224772 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.224910 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.225093 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.225206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.225348 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.225449 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.225660 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.225826 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.225980 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845990-2-iscsi {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.226139 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.226302 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.226455 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.226587 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.226783 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.226888 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.227109 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.227212 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.227420 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.227539 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.227765 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.227889 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.228078 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.228212 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.228399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.228590 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.228704 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.228916 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.229093 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.229224 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.229339 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.229528 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.229650 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.229957 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.230112 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.230329 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.230430 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.230638 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.230737 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.230890 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.230995 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.231198 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.231290 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.231521 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.231613 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.231835 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.231937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.232156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.232249 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845990-2-iscsi {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.232409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.232516 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.232662 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.232992 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.233105 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.233294 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.233387 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.233705 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.233798 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.234013 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.234105 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.234320 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.234429 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.234638 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.234781 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.234949 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.235041 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.235250 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.235348 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.235575 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.235678 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.235894 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.235986 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.236209 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.236331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.236529 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.236623 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.236832 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.236983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.237163 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.237304 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.237464 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.237654 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.237775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.238055 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.238170 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.238347 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.238454 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.238599 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.238711 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.238902 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.239060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.239217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.239412 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.239532 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.239750 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.239839 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.240083 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.240183 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.240329 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.240438 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.240643 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.240753 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.240980 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.241086 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.241285 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.241377 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.241589 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.241700 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.241888 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.241989 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.242189 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.242281 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.242472 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.242564 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.242777 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.242876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.243077 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.243177 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.243381 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.243480 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.243687 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.243788 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.243993 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.244091 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.244359 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.244528 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.244633 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.244764 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.244904 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.245000 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.245210 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.245362 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.245516 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.246138 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.246348 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.246443 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.246657 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.246822 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.246965 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.247090 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.247272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.247395 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.247576 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.247683 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.247872 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.247987 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.248190 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.248306 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.248489 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.248592 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.248795 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.248977 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.249120 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.249228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.249427 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.249518 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.249732 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.249830 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.250048 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.250144 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.250346 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.250457 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.250649 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.250754 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.250960 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.251051 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.251260 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.251350 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.251560 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.251650 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.251857 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.251956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.252155 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.252259 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.252455 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.252552 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.252756 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.252862 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.253077 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.253178 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.253378 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.253477 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.253678 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.253786 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.253976 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.254080 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.254273 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.254364 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.254570 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.254662 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.254874 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.255009 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.255186 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.255283 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.255498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.255600 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.255799 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.255893 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.256098 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.256190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.256396 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.256487 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.256695 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.256790 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.257030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.257200 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.257332 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.257448 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.257626 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.257757 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.257942 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.258089 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.258265 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.258437 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.258530 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.258773 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.258938 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.259110 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.259204 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.259413 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.259511 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.259727 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.259819 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.260023 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.260116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.260326 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.260418 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.260658 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.260829 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.260981 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.261070 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.261339 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.261482 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.261645 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.261749 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.262029 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.262129 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.262343 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.262436 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.262659 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.262760 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.262980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.263073 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.263277 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.263367 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.263575 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.263676 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.263888 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.263980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.264203 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.264303 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.264507 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.264615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.264811 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.264956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.265137 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.265232 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.265453 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:18.265553 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.265781 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.265871 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.266094 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.266196 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.266432 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.266530 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.266745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.266851 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.267074 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.267190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.267399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.267519 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.267711 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.267803 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.268021 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.268113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.268373 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.268478 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.268650 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.268749 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.268987 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.269083 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.269298 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.269401 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.269605 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.269698 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.269919 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.270010 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.270232 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.270332 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.270557 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.270653 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.270869 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.271015 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.271184 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.271285 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.271497 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.271596 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.271802 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.271908 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.272114 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.272238 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.272439 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.272556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.272753 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.272853 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.273355 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.273468 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.273695 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.273794 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.274038 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.274139 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.274347 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.274439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.274653 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.274745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.274970 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.275084 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.275279 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.275387 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.275573 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.275672 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.275880 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.275985 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.276197 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.276290 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.276524 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.276616 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.276851 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.277054 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.277322 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.277454 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.277634 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.277729 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.277947 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.278043 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.278259 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.278351 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.278573 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.278678 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.278880 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.278981 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.279193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.279292 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.279503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.279650 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.279812 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.279913 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.280120 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.280221 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.280431 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.280532 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.280733 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.280825 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.281064 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.281165 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.281370 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.281471 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.281672 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.281765 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.281973 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.282064 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.282275 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.282379 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.282582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.282680 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.282880 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.282968 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.283192 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.283362 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.283510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.283608 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.283813 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.283906 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.284122 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.284214 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.284427 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.284524 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.284731 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.284823 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.285061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.285156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.285386 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.285497 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.285661 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.285753 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.285966 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.286060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.286269 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.286360 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.286568 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.286658 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.286887 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.286986 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.287193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.287284 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.287489 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.287594 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.287796 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.287887 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.288096 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.288195 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.288399 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.288512 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.288698 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.288827 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.289025 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.289119 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.289329 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.289431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.289633 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.289726 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.289938 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.290037 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.290240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.290345 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.290544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.290646 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.290847 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.290938 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.291176 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.291277 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.291478 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.291569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.291789 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.291886 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.292108 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.292208 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.292426 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.293100 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.293300 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.293399 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.293602 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.293707 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.293907 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.294005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.294208 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.294308 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.294508 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.294601 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.294809 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.294912 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.295114 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.295214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.295413 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.295560 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.295714 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.295809 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.296011 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.296112 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.296312 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.296413 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.296613 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.296705 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.296951 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.297065 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.297257 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.297356 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.297554 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.297653 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.297851 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.297956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.298149 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.298253 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.298485 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.298585 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.298789 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.298914 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.299125 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.299238 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.299437 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.299540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.299753 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.299854 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.300063 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.300170 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.300367 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.300466 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.300677 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.300778 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.301006 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.301117 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.301313 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.301418 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.301618 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.301725 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.301923 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.302021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.302237 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.302328 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.302543 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.302641 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.302855 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.302953 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.303160 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.303265 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.303478 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.303584 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.303781 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.303879 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.304111 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.304213 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.304398 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.304489 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.304708 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.304798 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.305066 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.305194 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.305389 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.305526 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.305694 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.305789 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.306006 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.306115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.306307 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.306397 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.306608 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.306704 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.306911 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.307010 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.307216 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.307305 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.307518 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.307628 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.307827 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.307937 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.308222 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.308324 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.308532 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.308634 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.308865 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.309057 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.309244 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.309393 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.309585 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.309746 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.309899 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.310049 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.310189 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.310335 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.310475 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.310621 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.310762 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.310900 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.311038 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.311188 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.311333 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.311502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.311638 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.311778 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.311935 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.312082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.312226 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.312451 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.312591 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.312728 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.312894 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.313051 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.313145 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.313357 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.313451 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.313655 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.313753 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.313959 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.314059 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.314268 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.314368 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.314572 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.314664 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.314875 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.314979 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.315177 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.315269 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.315485 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.315586 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.315784 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.315936 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.316081 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.316175 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.316379 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.316472 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.316682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.316787 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.317022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.317119 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.317329 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.317433 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.317645 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.317747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.317961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.318060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.318259 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.318415 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.318557 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.318650 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.318872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.319015 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.319179 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.319304 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.319483 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.319602 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.319781 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.319887 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.320078 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.320171 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.320405 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.320498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.320707 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.320806 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.321027 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.321323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.321425 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.321638 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.321734 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.321941 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.322040 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.322247 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.322340 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.322552 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.322651 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.322854 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.322953 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.323171 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.323264 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.323478 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.323579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.324333 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.324442 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.324642 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.324853 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.324993 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.325156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.325251 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.325468 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.325562 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.325778 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.325892 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.326093 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.326198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.326402 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.326503 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.326706 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.326799 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.327014 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.327117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.327323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.327427 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.327629 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.327730 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.327933 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.328186 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.328288 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.328514 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.328616 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.328826 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.328940 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.329165 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.329279 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.329477 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.329579 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.329781 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.329918 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.330104 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.330207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.330413 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.330512 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.330715 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.330816 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.331018 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.331128 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.331318 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.331410 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.331620 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.331717 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.331921 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.332030 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.332226 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.332326 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.332526 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.332625 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.332826 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.332954 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.333168 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.333267 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.333471 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.333563 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.333854 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.333954 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.334161 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.334260 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.334458 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.334554 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.334759 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.334853 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.335065 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.335163 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.335366 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.335465 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.335668 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.335759 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.335966 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.336063 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.336288 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.336410 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.336589 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.336705 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.336914 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.337028 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.337205 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.337312 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.337501 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.337615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.337805 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.337903 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.338124 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.338320 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.338486 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.338647 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.338792 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.338940 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.339088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.339241 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.339351 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.339616 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.339730 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.339932 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.340070 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.340258 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.340359 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.340563 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.340664 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.340868 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.340993 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.341202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.341294 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.341509 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.341604 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.341817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.342044 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.342146 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.342232 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.342539 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.342721 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.342844 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.343011 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.343106 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.343191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.343302 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.343401 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.343602 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.343707 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.343909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.344009 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.344211 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.344310 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.344522 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.344616 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.344826 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.344981 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.345154 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.345247 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.345454 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.345556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.346016 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.346162 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.346276 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.346493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.346626 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.346740 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.346849 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.346959 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.347067 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.347184 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.347305 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.347416 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.347526 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.347635 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.347792 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.347894 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.348093 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.348186 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.348400 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.348503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.348703 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.348906 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.349010 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.349098 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.349338 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.349432 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.349648 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.349790 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.349950 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.350069 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.350250 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.350358 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.350654 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.350779 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.350874 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.351017 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.351119 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.351350 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.351451 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.351729 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.351828 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.352039 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.352168 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.352338 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.352440 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.352643 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.352740 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.352964 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.353095 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.353265 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.353401 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.353566 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.353659 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.353867 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.353959 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.354165 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.354267 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.354464 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.354563 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.354761 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.354861 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.355596 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.355696 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.355901 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.356006 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.356218 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.356319 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.356525 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.356650 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.356825 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.356977 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.357150 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.357278 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.357451 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.357557 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.357790 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.357891 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.358091 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.358183 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.358424 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.358528 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.358733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.358834 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.359037 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.359142 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.359351 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.359508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.359653 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.359882 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.360072 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.360252 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.360252 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.360591 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.360752 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.360933 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.361026 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.361131 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.361219 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.361322 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.361442 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.361537 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.361743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.361845 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.362041 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.362134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.362358 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.362459 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.362665 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.362766 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.362969 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.363069 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.363286 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.363379 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.363602 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.363696 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.363905 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.364005 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.364209 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.364301 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.364512 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.364612 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.364816 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.364972 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.365144 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.365289 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.365447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.365604 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.365752 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.365930 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.366080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.366223 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.366331 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.366538 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.366694 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.366854 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.366947 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.367170 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.367272 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.367480 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.367600 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.367799 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.367910 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.368099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.368200 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.368397 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.368561 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.368719 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.368857 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.369044 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.369154 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.369347 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.369460 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.369650 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.369747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.369953 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.370073 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.370257 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.370360 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.370557 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.370757 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.371003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.371212 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.371314 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.371526 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.371627 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.371836 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.371938 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.372139 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.372333 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.372433 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.372651 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.372785 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.373010 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.373112 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.373363 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.373463 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.373667 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.373768 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.374080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.374180 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.374387 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.374479 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.374694 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.374792 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.374998 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.375097 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.375298 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.375389 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.375599 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.375691 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.375902 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.375995 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.376223 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.376326 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.376520 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.376619 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.376820 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.376959 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.377143 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.377242 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.377459 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.377558 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.377757 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.377849 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.378076 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.378254 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.378460 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.378578 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.378782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.378896 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.379083 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.379249 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.379490 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.379686 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.379801 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.379902 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.380103 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.380203 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.380420 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.380512 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.380738 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.380850 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.381085 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.381183 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.381382 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.381473 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.381691 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.381795 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.381997 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.382095 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.382318 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.382409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.382635 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.382735 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.382939 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.383029 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.383247 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.383344 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.383547 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.383646 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.383863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.383955 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.384180 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.384278 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.384487 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.384580 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.384804 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.384922 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.385165 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.385268 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.385479 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.385586 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.385803 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.385901 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.386125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.386733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.386973 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.387070 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.387280 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.387389 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.387576 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.387683 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.387881 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.387979 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.388182 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.388292 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.388478 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.388580 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.388800 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.388986 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.389125 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.389320 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.389426 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.389646 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.389738 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.389980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.390072 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.390303 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.390405 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.390598 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.390712 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.390919 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.391087 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.391239 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.391407 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.391554 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.391691 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.391832 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.391979 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.392125 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.392277 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.392417 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.392580 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.392725 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.392866 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.393033 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.393182 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.393382 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.393487 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.393636 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.393772 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.393933 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.394081 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.394232 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.394392 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.394570 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.394700 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.394874 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.395007 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.395191 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.395311 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.395517 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.395635 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.395845 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.395947 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.396152 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.396245 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.396481 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.396574 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.396801 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.396928 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.397160 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.397263 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.397437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.397536 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.397755 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.397848 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.398314 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.398447 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.398623 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.398727 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.398934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.399066 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.399234 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.399339 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.399533 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.399646 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.399834 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.399942 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.400142 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.400244 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.400440 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.400630 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.400746 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.400907 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.401048 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.401159 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.401367 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.401468 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.401685 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.401785 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.402123 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.402340 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.402503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.402650 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.402744 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.402953 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.403044 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.403256 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.403361 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.403560 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.403661 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.403897 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.404161 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.404261 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.404491 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.404585 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.404807 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.404951 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.405146 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.405238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.405462 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.405556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.405770 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.405861 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.406082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.406181 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.406391 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.406483 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.406701 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.406800 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.407046 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.407304 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.407403 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.407488 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.407612 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.407704 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.407922 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.408026 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.408231 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.408322 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.408535 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.408626 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.408846 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.409036 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.409168 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.409264 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.409477 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.409587 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.409829 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.409999 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.410212 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.410331 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.410533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.410654 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.410857 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.410959 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.411152 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.411263 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.411467 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.411571 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.411793 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.411901 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.412113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.412208 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.412416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.412538 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.412727 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.412821 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.413060 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.413163 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.413375 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.413500 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.413689 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.413795 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.414005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.414140 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.414330 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.414448 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.414678 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.414778 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.414989 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.415088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.415303 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.415403 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.415613 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.415706 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.415926 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.416025 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.416243 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.416336 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.416551 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.416766 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.416856 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.417106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.417212 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.417443 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.418084 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.418316 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.418426 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.418647 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.418823 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.418974 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.419125 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.419262 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.419444 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.419604 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.419754 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.419872 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.420068 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.420180 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.420379 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.420535 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.420701 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.420841 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.421030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.421124 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.421367 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.421536 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.421697 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.421836 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.421971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.422118 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.422269 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.422408 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.422576 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.422716 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.423085 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.423241 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.423401 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.423539 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.423716 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.423877 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.424052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.424203 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.424346 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.424484 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.424645 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.424792 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.424983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.425087 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.425304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.425403 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.425612 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.425710 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.425911 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.426010 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.426218 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.426310 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.426523 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.426615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.426824 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.426917 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.427127 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.427217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.427434 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.427537 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.427731 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.427825 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.428035 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.428124 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.428337 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.428434 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.428639 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.428860 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.429043 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.429223 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.429343 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.429537 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.429665 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.429861 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.429961 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.430169 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.430260 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.430474 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.430576 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.430783 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.430885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.431165 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.431267 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.431398 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.431490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.431702 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.431792 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.432014 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.432107 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.432322 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.432414 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.432624 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.432716 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.432948 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.433044 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.433301 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.433504 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.433615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.433821 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.433951 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.434125 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.434279 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.434434 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.434586 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.434855 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.434955 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.435187 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.435288 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.435494 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.435592 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.435796 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.435895 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.436099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.436192 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.436405 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.436503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.436706 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.436804 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.437032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.437137 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.437334 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.437594 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.437695 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.437930 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.438022 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.438231 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.438331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.438534 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.438632 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.438834 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.438967 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.439139 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.439230 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.439438 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.439536 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.439740 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.439881 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.440074 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.440165 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.440385 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.440477 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.440683 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.440798 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.441015 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.441122 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.441325 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.441437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.441625 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.441724 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.441932 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.442032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.442239 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.442337 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.442543 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.442634 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.442851 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.442950 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.443177 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.443317 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.443495 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.443691 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.443793 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.444025 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.444169 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.444342 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.444445 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.444670 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.444771 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.445020 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.445131 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.445325 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.445417 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.445629 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.445720 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.445930 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.446035 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.446248 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.446347 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.446552 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.446645 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.446858 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.446963 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.447162 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.447255 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.447467 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.447558 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.447773 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.447869 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.448077 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.448176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.448381 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.448481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.448689 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.449353 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.449548 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.449642 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.449935 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.450026 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.450252 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.450351 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.450560 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.450658 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.450866 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.450971 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.451183 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.451274 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.451496 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.451598 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.451815 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.451918 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.452127 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.452216 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.452440 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.452533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.452753 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.452854 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.453087 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.453187 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.453412 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.453506 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.453706 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.453798 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.454011 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.454101 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.454325 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.454418 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.454636 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.454735 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.454948 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.455045 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.455249 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.455348 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.455555 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.455647 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.455862 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.455959 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.456172 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.456272 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.456478 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.456577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.456784 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.456905 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.457112 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.457241 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.457420 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.457511 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.457764 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.457867 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.458058 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.458159 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.458368 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.458466 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.458676 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.458775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.458984 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.459083 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.459289 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.459380 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.459594 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.459701 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.460388 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.460503 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.460503 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.460665 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.460756 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.460841 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.460983 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.461077 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.461150 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.461218 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.461415 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.461524 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.461719 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.461829 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.462021 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.462115 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.462328 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.462429 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.462627 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.462725 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.462926 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.463018 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.463227 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.463328 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.463528 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.463627 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.463833 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.463924 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.464135 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.464240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.464542 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.464698 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.464984 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.465163 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.465328 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.465483 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.465600 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.465765 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.465910 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.466105 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.466213 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.466440 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.466539 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.466756 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.466849 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.467068 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.467169 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.467369 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.467467 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.467672 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.467773 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.468000 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.468111 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.468330 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.468429 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.468642 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.468744 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.468985 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.469097 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.469293 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.469409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.469651 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.469741 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.469963 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.470107 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.470285 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.470414 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.470603 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.470765 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.470918 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.471080 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.471268 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.471419 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.471559 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.471751 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.471891 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.472047 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.472146 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.472366 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.472459 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.472707 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.472802 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.473070 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.473162 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.473379 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.473471 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.473701 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.473795 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.474023 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.474125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.474330 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.474428 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.474653 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.474802 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.474973 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.475137 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.475280 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.475457 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.475607 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.475790 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.475940 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.476147 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.476291 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.476482 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.476637 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.476782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.476992 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.477084 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 00:26:18.477175 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.477403 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.477711 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.478027 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.478337 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.478662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.478989 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.479298 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.479639 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.480469 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.480831 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.481166 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.481514 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.481840 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.482153 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.482459 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.482762 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:18.483001 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 00:26:18.545969 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO dbcounter [None req-ce524d7b-d3d6-42ce-a39d-c1be93031078 None None] Registered counter for database nova_api Jun 16 00:26:18.549048 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO dbcounter [None req-421dfdba-d642-4c67-ac30-0e257819eb6f None None] Registered counter for database nova_api Jun 16 00:26:18.566655 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_db.sqlalchemy.engines [None req-ce524d7b-d3d6-42ce-a39d-c1be93031078 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:26:18.569454 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_db.sqlalchemy.engines [None req-421dfdba-d642-4c67-ac30-0e257819eb6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124230) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:26:18.573775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writer thread running {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:26:18.576527 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writer thread running {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:26:18.633522 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.context [None req-ce524d7b-d3d6-42ce-a39d-c1be93031078 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1da0db6-963b-492e-ab04-011cf8144663(cell1) {{(pid=124231) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 00:26:18.637930 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ce524d7b-d3d6-42ce-a39d-c1be93031078 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:18.638420 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.context [None req-421dfdba-d642-4c67-ac30-0e257819eb6f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1da0db6-963b-492e-ab04-011cf8144663(cell1) {{(pid=124230) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 00:26:18.639493 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ce524d7b-d3d6-42ce-a39d-c1be93031078 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:18.640277 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ce524d7b-d3d6-42ce-a39d-c1be93031078 None None] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:18.642248 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ce524d7b-d3d6-42ce-a39d-c1be93031078 None None] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:18.642688 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-421dfdba-d642-4c67-ac30-0e257819eb6f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:18.644301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO dbcounter [None req-ce524d7b-d3d6-42ce-a39d-c1be93031078 None None] Registered counter for database nova_cell0 Jun 16 00:26:18.644415 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-421dfdba-d642-4c67-ac30-0e257819eb6f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:18.645376 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-421dfdba-d642-4c67-ac30-0e257819eb6f None None] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:18.647610 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-421dfdba-d642-4c67-ac30-0e257819eb6f None None] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:18.648364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO dbcounter [None req-ce524d7b-d3d6-42ce-a39d-c1be93031078 None None] Registered counter for database nova_cell1 Jun 16 00:26:18.650041 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO dbcounter [None req-421dfdba-d642-4c67-ac30-0e257819eb6f None None] Registered counter for database nova_cell0 Jun 16 00:26:18.654899 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO dbcounter [None req-421dfdba-d642-4c67-ac30-0e257819eb6f None None] Registered counter for database nova_cell1 Jun 16 00:26:18.657162 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_db.sqlalchemy.engines [None req-ce524d7b-d3d6-42ce-a39d-c1be93031078 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:26:18.659089 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_db.sqlalchemy.engines [None req-ce524d7b-d3d6-42ce-a39d-c1be93031078 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:26:18.662466 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_db.sqlalchemy.engines [None req-421dfdba-d642-4c67-ac30-0e257819eb6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124230) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:26:18.664284 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writer thread running {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:26:18.667483 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writer thread running {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:26:18.669246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writer thread running {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:26:18.670646 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_db.sqlalchemy.engines [None req-421dfdba-d642-4c67-ac30-0e257819eb6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124230) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:26:18.817171 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writer thread running {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:26:18.819188 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO dbcounter [None req-ce524d7b-d3d6-42ce-a39d-c1be93031078 None None] Registered counter for database nova_cell0 Jun 16 00:26:18.827958 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO dbcounter [None req-421dfdba-d642-4c67-ac30-0e257819eb6f None None] Registered counter for database nova_cell0 Jun 16 00:26:18.828160 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_db.sqlalchemy.engines [None req-ce524d7b-d3d6-42ce-a39d-c1be93031078 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:26:18.832774 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writer thread running {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:26:18.834843 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_db.sqlalchemy.engines [None req-421dfdba-d642-4c67-ac30-0e257819eb6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124230) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:26:18.839578 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writer thread running {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:26:19.150712 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: WARNING keystonemiddleware.auth_token [None req-ce524d7b-d3d6-42ce-a39d-c1be93031078 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:26:19.158513 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: WARNING keystonemiddleware.auth_token [None req-ce524d7b-d3d6-42ce-a39d-c1be93031078 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:26:19.161979 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: WARNING keystonemiddleware.auth_token [None req-421dfdba-d642-4c67-ac30-0e257819eb6f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:26:19.170277 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: WARNING keystonemiddleware.auth_token [None req-421dfdba-d642-4c67-ac30-0e257819eb6f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:26:19.503428 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: WARNING keystonemiddleware.auth_token [None req-ce524d7b-d3d6-42ce-a39d-c1be93031078 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:26:19.510910 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: WARNING keystonemiddleware.auth_token [None req-ce524d7b-d3d6-42ce-a39d-c1be93031078 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:26:19.517815 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55916256d9c0 pid: 124231 (default app) Jun 16 00:26:19.525373 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: WARNING keystonemiddleware.auth_token [None req-421dfdba-d642-4c67-ac30-0e257819eb6f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:26:19.531545 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: WARNING keystonemiddleware.auth_token [None req-421dfdba-d642-4c67-ac30-0e257819eb6f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:26:19.537171 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55916256d9c0 pid: 124230 (default app) Jun 16 00:26:59.902160 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=3 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:59.903918 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=3 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:59.903918 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=3 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:59.904782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=3 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:00.739526 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=3 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:00.741405 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=3 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:00.742865 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=3 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:00.744096 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=3 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:01.336683 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-5465524c-a5c9-4aff-b145-856f37167b20 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Action: 'create', calling method: .version_select at 0x7fe706a8a820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-877251849"}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:01.852508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-22e6bb48-5a7f-438c-b248-c5d2b6a49217 tempest-VolumesGetTestJSON-945444666 tempest-VolumesGetTestJSON-945444666-project] Action: 'create', calling method: .version_select at 0x7fe706a8a790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1067254772", "metadata": {"Type": "work"}}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:02.499632 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-5465524c-a5c9-4aff-b145-856f37167b20 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.607384 Jun 16 00:27:02.506874 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1154 bytes} [Thu Jun 16 00:26:59 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2610 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 00:27:02.513295 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-afae2f98-290e-4cd0-9bf8-f29794adaafd tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Calling method '.version_select at 0x7fe706955670>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:02.614628 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-afae2f98-290e-4cd0-9bf8-f29794adaafd tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/8218f987-212c-4e7d-97e2-b0a8e31294ea" status: 200 len: 344 microversion: 2.1 time: 0.106182 Jun 16 00:27:02.615205 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 2/2] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Jun 16 00:27:02 2022] GET /compute/v2.1/os-volumes/8218f987-212c-4e7d-97e2-b0a8e31294ea => generated 344 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:03.019372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-a2845bae-61a1-4c5d-b0f6-7f9a3f208ccc tempest-VolumesTestJSON-747968291 tempest-VolumesTestJSON-747968291-project] Calling method '.version_select at 0x7fe706955790>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:03.132320 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-22e6bb48-5a7f-438c-b248-c5d2b6a49217 tempest-VolumesGetTestJSON-945444666 tempest-VolumesGetTestJSON-945444666-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.413936 Jun 16 00:27:03.133524 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1155 bytes} [Thu Jun 16 00:27:00 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2417 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 00:27:03.148117 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-3a0e3816-63eb-47ea-aafe-2232938edd6c tempest-VolumesGetTestJSON-945444666 tempest-VolumesGetTestJSON-945444666-project] Calling method '.version_select at 0x7fe7069565e0>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:03.164629 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-a2845bae-61a1-4c5d-b0f6-7f9a3f208ccc tempest-VolumesTestJSON-747968291 tempest-VolumesTestJSON-747968291-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/5c20c740-63e5-459d-aeb5-385d486b8b68" status: 200 len: 349 microversion: 2.1 time: 0.149119 Jun 16 00:27:03.177617 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 3/4] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Jun 16 00:27:03 2022] GET /compute/v2.1/os-volumes/5c20c740-63e5-459d-aeb5-385d486b8b68 => generated 349 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:03.302706 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-3a0e3816-63eb-47ea-aafe-2232938edd6c tempest-VolumesGetTestJSON-945444666 tempest-VolumesGetTestJSON-945444666-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c" status: 200 len: 353 microversion: 2.1 time: 0.160537 Jun 16 00:27:03.303377 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 2/5] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Jun 16 00:27:03 2022] GET /compute/v2.1/os-volumes/aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c => generated 353 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:03.638726 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-9bf0e45b-46bc-43d6-b6d1-fe2fe3952f12 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Calling method '.version_select at 0x7fe706955e50>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:03.853751 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-9bf0e45b-46bc-43d6-b6d1-fe2fe3952f12 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/8218f987-212c-4e7d-97e2-b0a8e31294ea" status: 200 len: 345 microversion: 2.1 time: 0.229563 Jun 16 00:27:03.854517 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 4/6] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Jun 16 00:27:03 2022] GET /compute/v2.1/os-volumes/8218f987-212c-4e7d-97e2-b0a8e31294ea => generated 345 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:03.866367 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-bd14f89f-fc92-4765-8c6e-99e45c0d641b tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Action: 'create', calling method: .version_select at 0x7fe706956940>, body: {"snapshot": {"volume_id": "8218f987-212c-4e7d-97e2-b0a8e31294ea", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1824367406"}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:04.315320 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-bd14f89f-fc92-4765-8c6e-99e45c0d641b tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.448818 Jun 16 00:27:04.316103 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 3/7] 10.222.0.23 () {60 vars in 1161 bytes} [Thu Jun 16 00:27:03 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:04.318550 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-215e8895-61c1-4d42-ac79-a4303f42798f tempest-VolumesGetTestJSON-945444666 tempest-VolumesGetTestJSON-945444666-project] Calling method '.version_select at 0x7fe706967550>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:04.330912 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-dae5fd1a-7447-4f25-8b8b-7577764fde11 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Calling method '.version_select at 0x7fe706965310>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:04.381002 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-dae5fd1a-7447-4f25-8b8b-7577764fde11 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/94cc2d31-c3a7-4572-a79d-fb051b765799" status: 200 len: 287 microversion: 2.1 time: 0.058207 Jun 16 00:27:04.381845 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1250 bytes} [Thu Jun 16 00:27:04 2022] GET /compute/v2.1/os-snapshots/94cc2d31-c3a7-4572-a79d-fb051b765799 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:27:04.393311 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-7d2103c1-d333-4938-9d5b-6f722702949c tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Calling method '.version_select at 0x7fe7069659d0>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:04.451202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-215e8895-61c1-4d42-ac79-a4303f42798f tempest-VolumesGetTestJSON-945444666 tempest-VolumesGetTestJSON-945444666-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c" status: 200 len: 354 microversion: 2.1 time: 0.138386 Jun 16 00:27:04.451762 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 5/9] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Jun 16 00:27:04 2022] GET /compute/v2.1/os-volumes/aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c => generated 354 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:04.465184 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b81e5f76-5e81-4de6-b666-4eb93df4df56 tempest-VolumesGetTestJSON-945444666 tempest-VolumesGetTestJSON-945444666-project] Calling method '.version_select at 0x7fe706955d30>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:04.489166 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-7d2103c1-d333-4938-9d5b-6f722702949c tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.100209 Jun 16 00:27:04.489752 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 5/10] 10.222.0.23 () {58 vars in 1139 bytes} [Thu Jun 16 00:27:04 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:27:04.501794 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-96ad5cce-2a11-4ea8-9c3c-51c1912f5797 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Calling method '.version_select at 0x7fe706965d30>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:04.561957 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-96ad5cce-2a11-4ea8-9c3c-51c1912f5797 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/94cc2d31-c3a7-4572-a79d-fb051b765799" status: 200 len: 287 microversion: 2.1 time: 0.064333 Jun 16 00:27:04.563645 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 6/11] 10.222.0.23 () {58 vars in 1250 bytes} [Thu Jun 16 00:27:04 2022] GET /compute/v2.1/os-snapshots/94cc2d31-c3a7-4572-a79d-fb051b765799 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:04.569801 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-b81e5f76-5e81-4de6-b666-4eb93df4df56 tempest-VolumesGetTestJSON-945444666 tempest-VolumesGetTestJSON-945444666-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c" status: 200 len: 354 microversion: 2.1 time: 0.109498 Jun 16 00:27:04.570673 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Jun 16 00:27:04 2022] GET /compute/v2.1/os-volumes/aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:04.597223 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-af2de4f3-186d-4835-8db5-2182f5d47a5c tempest-VolumesGetTestJSON-945444666 tempest-VolumesGetTestJSON-945444666-project] Calling method '.version_select at 0x7fe7069654c0>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:04.730094 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-af2de4f3-186d-4835-8db5-2182f5d47a5c tempest-VolumesGetTestJSON-945444666 tempest-VolumesGetTestJSON-945444666-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c" status: 202 len: 0 microversion: 2.1 time: 0.141109 Jun 16 00:27:04.731755 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1247 bytes} [Thu Jun 16 00:27:04 2022] DELETE /compute/v2.1/os-volumes/aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:27:04.740283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-881e6f17-a5c6-4f8a-ac11-6d79fc2418bd tempest-VolumesGetTestJSON-945444666 tempest-VolumesGetTestJSON-945444666-project] Calling method '.version_select at 0x7fe7069559d0>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:04.816514 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-881e6f17-a5c6-4f8a-ac11-6d79fc2418bd tempest-VolumesGetTestJSON-945444666 tempest-VolumesGetTestJSON-945444666-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c" status: 200 len: 353 microversion: 2.1 time: 0.080509 Jun 16 00:27:04.822257 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 7/14] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Jun 16 00:27:04 2022] GET /compute/v2.1/os-volumes/aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c => generated 353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:27:04.935978 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-15572b6a-6540-44d1-b6d6-a406de88ee3e tempest-VolumesTestJSON-747968291 tempest-VolumesTestJSON-747968291-project] Calling method '.version_select at 0x7fe706956d30>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:05.038275 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-15572b6a-6540-44d1-b6d6-a406de88ee3e tempest-VolumesTestJSON-747968291 tempest-VolumesTestJSON-747968291-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3998a2f4-760a-4287-b375-2db2f966ef6d" status: 200 len: 351 microversion: 2.1 time: 0.106171 Jun 16 00:27:05.061813 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 8/15] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Jun 16 00:27:04 2022] GET /compute/v2.1/os-volumes/3998a2f4-760a-4287-b375-2db2f966ef6d => generated 351 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:05.581311 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d283add8-09ba-489f-89e8-2a51e36accfe tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Calling method '.version_select at 0x7fe7069675e0>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:05.618942 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-d283add8-09ba-489f-89e8-2a51e36accfe tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/94cc2d31-c3a7-4572-a79d-fb051b765799" status: 200 len: 287 microversion: 2.1 time: 0.048625 Jun 16 00:27:05.620140 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 8/16] 10.222.0.23 () {58 vars in 1250 bytes} [Thu Jun 16 00:27:05 2022] GET /compute/v2.1/os-snapshots/94cc2d31-c3a7-4572-a79d-fb051b765799 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:05.840125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8c281ee0-891c-471c-8d20-36da2fe603b2 tempest-VolumesGetTestJSON-945444666 tempest-VolumesGetTestJSON-945444666-project] Calling method '.version_select at 0x7fe7069651f0>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:05.972039 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-8c281ee0-891c-471c-8d20-36da2fe603b2 tempest-VolumesGetTestJSON-945444666 tempest-VolumesGetTestJSON-945444666-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c" status: 200 len: 353 microversion: 2.1 time: 0.142783 Jun 16 00:27:05.972904 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 9/17] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Jun 16 00:27:05 2022] GET /compute/v2.1/os-volumes/aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c => generated 353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:06.632242 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-27ec6435-8b40-4030-a7f2-56698e6c374d tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Calling method '.version_select at 0x7fe706955790>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:06.700070 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-27ec6435-8b40-4030-a7f2-56698e6c374d tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/94cc2d31-c3a7-4572-a79d-fb051b765799" status: 200 len: 287 microversion: 2.1 time: 0.071288 Jun 16 00:27:06.700822 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 9/18] 10.222.0.23 () {58 vars in 1250 bytes} [Thu Jun 16 00:27:06 2022] GET /compute/v2.1/os-snapshots/94cc2d31-c3a7-4572-a79d-fb051b765799 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:06.984672 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-e4a29355-6f33-47f7-9334-e9e9cf140a28 tempest-VolumesGetTestJSON-945444666 tempest-VolumesGetTestJSON-945444666-project] Calling method '.version_select at 0x7fe706965940>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:07.051203 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-e4a29355-6f33-47f7-9334-e9e9cf140a28 tempest-VolumesGetTestJSON-945444666 tempest-VolumesGetTestJSON-945444666-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c" status: 200 len: 353 microversion: 2.1 time: 0.066471 Jun 16 00:27:07.051695 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 10/19] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Jun 16 00:27:06 2022] GET /compute/v2.1/os-volumes/aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c => generated 353 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:07.713138 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-4842bd30-d511-462f-98aa-071f2cc1c740 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Calling method '.version_select at 0x7fe706955e50>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:07.907928 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-4842bd30-d511-462f-98aa-071f2cc1c740 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/94cc2d31-c3a7-4572-a79d-fb051b765799" status: 200 len: 288 microversion: 2.1 time: 0.199703 Jun 16 00:27:07.908767 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 10/20] 10.222.0.23 () {58 vars in 1250 bytes} [Thu Jun 16 00:27:07 2022] GET /compute/v2.1/os-snapshots/94cc2d31-c3a7-4572-a79d-fb051b765799 => generated 288 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:07.921250 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-dc9cd0a8-9068-478f-a490-552615bdf626 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Calling method '.version_select at 0x7fe706956c10>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:08.031738 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-f019f535-ec1a-435e-8704-d93e1155869e tempest-VolumesTestJSON-747968291 tempest-VolumesTestJSON-747968291-project] Calling method '.version_select at 0x7fe7069674c0>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:08.148313 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-dc9cd0a8-9068-478f-a490-552615bdf626 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/94cc2d31-c3a7-4572-a79d-fb051b765799" status: 202 len: 0 microversion: 2.1 time: 0.232784 Jun 16 00:27:08.150349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 11/21] 10.222.0.23 () {58 vars in 1253 bytes} [Thu Jun 16 00:27:07 2022] DELETE /compute/v2.1/os-snapshots/94cc2d31-c3a7-4572-a79d-fb051b765799 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:27:08.157390 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8a047059-67f3-437d-ba90-25ca0879e059 tempest-VolumesGetTestJSON-945444666 tempest-VolumesGetTestJSON-945444666-project] Calling method '.version_select at 0x7fe706956b80>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:08.224469 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-8a047059-67f3-437d-ba90-25ca0879e059 tempest-VolumesGetTestJSON-945444666 tempest-VolumesGetTestJSON-945444666-project] HTTP exception thrown: Volume aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c could not be found. Jun 16 00:27:08.228982 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8a047059-67f3-437d-ba90-25ca0879e059 tempest-VolumesGetTestJSON-945444666 tempest-VolumesGetTestJSON-945444666-project] Request method failure captured: Jun 16 00:27:08.228982 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: GET /compute/v2.1/os-volumes/aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c HTTP/1.1 Jun 16 00:27:08.228982 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:27:08.228982 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:27:08.228982 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:27:08.228982 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:27:08.228982 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:27:08.228982 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:27:08.228982 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:27:08.228982 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:27:08.228982 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnjUJoPWeycPbxVcfAUntk3rxKyk_FwbNE0aG_yFlQq24eDrPzyHFD-dx65K0I5OrRx9iLa59es9Pga8k63eY2YJVrNLM8qMLMI1zt8TlvjYs9BVrSG6Eaw6A4k7oq_HszbJuW-8PBD9_8mfzpGPtSZmj7y1OkHwuPPEnoo-aLDY_OA Jun 16 00:27:08.228982 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:27:08.228982 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:27:08.228982 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:27:08.228982 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:27:08.228982 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:27:08.228982 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:27:08.228982 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: 9eeb911e348948edaccb0f977a645c39 Jun 16 00:27:08.228982 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-VolumesGetTestJSON-945444666 Jun 16 00:27:08.228982 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:27:08.228982 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:27:08.230045 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9eeb911e348948edaccb0f977a645c39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9eeb911e348948edaccb0f977a645c39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9eeb911e348948edaccb0f977a645c39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9eeb911e348948edaccb0f977a645c39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:27:08.230045 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-VolumesGetTestJSON-945444666 Jun 16 00:27:08.230045 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: 9eeb911e348948edaccb0f977a645c39 Jun 16 00:27:08.230045 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-VolumesGetTestJSON-945444666 Jun 16 00:27:08.230045 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-VolumesGetTestJSON-945444666-project Jun 16 00:27:08.230045 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:27:08.230045 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:27:08.230045 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: cd12200a054240e389eca80f2c16f59c Jun 16 00:27:08.230045 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-VolumesGetTestJSON-945444666-project Jun 16 00:27:08.230045 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: Jun 16 00:27:08.230045 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Volume aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c could not be found. Jun 16 00:27:08.230045 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'id': 'aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c'} Jun 16 00:27:08.230045 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:27:08.230662 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:08.230662 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:27:08.230662 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:27:08.230662 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:27:08.230662 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:27:08.230662 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:27:08.230662 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:27:08.230662 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:27:08.230662 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:27:08.230662 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:27:08.230662 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:27:08.230662 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:27:08.230662 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:27:08.230662 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:27:08.230662 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:27:08.230662 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c could not be found. (HTTP 404) (Request-ID: req-b4c5f3ef-2516-40cb-878e-40a3572a962d) Jun 16 00:27:08.230662 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:27:08.230662 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:08.230662 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:27:08.231503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:08.231503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 00:27:08.231503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 00:27:08.231503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:27:08.231503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:27:08.231503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 00:27:08.231503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 00:27:08.231503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:27:08.231503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:27:08.231503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:27:08.231503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:27:08.231503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:27:08.231503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:27:08.231503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:27:08.231503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:27:08.231503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:27:08.231503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:27:08.231503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:27:08.231503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:27:08.232349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:27:08.232349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:27:08.232349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:27:08.232349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:27:08.232349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c could not be found. Jun 16 00:27:08.232349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:27:08.232349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:08.232349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:27:08.232349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:08.232349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:08.232349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:08.232349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:27:08.232349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:27:08.232349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:27:08.232349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:27:08.232349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:27:08.232349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:27:08.232349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 00:27:08.232349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:27:08.233247 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c could not be found. Jun 16 00:27:08.233247 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:27:08.233247 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:08.233247 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:27:08.233247 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:08.233247 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:08.233247 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:08.233247 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:27:08.233247 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:27:08.233247 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c could not be found. Jun 16 00:27:08.233247 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:27:08.233247 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8a047059-67f3-437d-ba90-25ca0879e059 tempest-VolumesGetTestJSON-945444666 tempest-VolumesGetTestJSON-945444666-project] Returning 404 to user: Volume aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c could not be found. {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:27:08.233247 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-8a047059-67f3-437d-ba90-25ca0879e059 tempest-VolumesGetTestJSON-945444666 tempest-VolumesGetTestJSON-945444666-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c" status: 404 len: 109 microversion: 2.1 time: 0.079128 Jun 16 00:27:08.233247 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 12/22] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Jun 16 00:27:08 2022] GET /compute/v2.1/os-volumes/aeb8f15d-5d5a-42b8-b0e4-7a8e8389ed9c => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:27:08.254973 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-f019f535-ec1a-435e-8704-d93e1155869e tempest-VolumesTestJSON-747968291 tempest-VolumesTestJSON-747968291-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/72f73d7a-b0cb-44d9-b122-71239f6ec750" status: 200 len: 351 microversion: 2.1 time: 0.227230 Jun 16 00:27:08.263375 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 11/23] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Jun 16 00:27:08 2022] GET /compute/v2.1/os-volumes/72f73d7a-b0cb-44d9-b122-71239f6ec750 => generated 351 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:08.269367 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-72675b06-1a28-4406-bc7c-32ca21c98be7 tempest-VolumesTestJSON-747968291 tempest-VolumesTestJSON-747968291-project] Calling method '.version_select at 0x7fe706967e50>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:08.274038 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-285b9b45-43b4-4a6c-a198-9fd38c0db101 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Calling method '.version_select at 0x7fe7068e20d0>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:08.376258 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-285b9b45-43b4-4a6c-a198-9fd38c0db101 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/94cc2d31-c3a7-4572-a79d-fb051b765799" status: 200 len: 287 microversion: 2.1 time: 0.143575 Jun 16 00:27:08.377113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 13/24] 10.222.0.23 () {58 vars in 1250 bytes} [Thu Jun 16 00:27:08 2022] GET /compute/v2.1/os-snapshots/94cc2d31-c3a7-4572-a79d-fb051b765799 => generated 287 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:08.573908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-72675b06-1a28-4406-bc7c-32ca21c98be7 tempest-VolumesTestJSON-747968291 tempest-VolumesTestJSON-747968291-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.309358 Jun 16 00:27:08.574605 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 12/25] 10.222.0.23 () {58 vars in 1133 bytes} [Thu Jun 16 00:27:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:08.590528 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-9da55217-15a1-4873-88e1-3d684095d5dd tempest-VolumesTestJSON-747968291 tempest-VolumesTestJSON-747968291-project] Calling method '.version_select at 0x7fe7073398b0>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:08.945101 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-9da55217-15a1-4873-88e1-3d684095d5dd tempest-VolumesTestJSON-747968291 tempest-VolumesTestJSON-747968291-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.358863 Jun 16 00:27:08.946304 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 14/26] 10.222.0.23 () {58 vars in 1148 bytes} [Thu Jun 16 00:27:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:08.961088 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-9cdfba3b-f8e7-410e-974c-c9ee22c1f6b5 tempest-VolumesTestJSON-747968291 tempest-VolumesTestJSON-747968291-project] Calling method '.version_select at 0x7fe706967dc0>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:09.180782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-9cdfba3b-f8e7-410e-974c-c9ee22c1f6b5 tempest-VolumesTestJSON-747968291 tempest-VolumesTestJSON-747968291-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.225390 Jun 16 00:27:09.181900 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 13/27] 10.222.0.23 () {58 vars in 1133 bytes} [Thu Jun 16 00:27:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:09.196775 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-2741959f-d51a-4b96-8267-2e5f05791682 tempest-VolumesTestJSON-747968291 tempest-VolumesTestJSON-747968291-project] Calling method '.version_select at 0x7fe7068e2160>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:09.384295 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-2741959f-d51a-4b96-8267-2e5f05791682 tempest-VolumesTestJSON-747968291 tempest-VolumesTestJSON-747968291-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.193899 Jun 16 00:27:09.386190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 15/28] 10.222.0.23 () {58 vars in 1166 bytes} [Thu Jun 16 00:27:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:09.397381 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-ec9899fa-b2f8-4162-9460-e5471385637a tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Calling method '.version_select at 0x7fe7069554c0>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:09.398751 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-0301276b-751d-4ade-a993-7ff30fc207ef tempest-VolumesTestJSON-747968291 tempest-VolumesTestJSON-747968291-project] Calling method '.version_select at 0x7fe7068e6280>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:09.445066 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-ec9899fa-b2f8-4162-9460-e5471385637a tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] HTTP exception thrown: Snapshot 94cc2d31-c3a7-4572-a79d-fb051b765799 could not be found. Jun 16 00:27:09.453743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-ec9899fa-b2f8-4162-9460-e5471385637a tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Request method failure captured: Jun 16 00:27:09.453743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: GET /compute/v2.1/os-snapshots/94cc2d31-c3a7-4572-a79d-fb051b765799 HTTP/1.1 Jun 16 00:27:09.453743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:27:09.453743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:27:09.453743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:27:09.453743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:27:09.453743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:27:09.453743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:27:09.453743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:27:09.453743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:27:09.453743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnjT0SJQNMKXYuNT9l6hr3KGB2dM89KYMOUj8HhD_sejSzuOo3Pr8TFgT6AtYXFhHHUFklTrL4hu5JdAwz3p3eg2xBfGXP4O4-m54mwOJ13EgKdmciIhKjOB41KTT4okGanu5g4HNrvQnhkdBsZDifIztxSJv2LPV35IgSfCI22_GC0 Jun 16 00:27:09.453743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:27:09.453743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:27:09.453743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:27:09.453743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:27:09.453743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:27:09.453743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:27:09.453743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: 8256b9c4822941639662d00143e57bf4 Jun 16 00:27:09.453743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1786509504 Jun 16 00:27:09.453743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:27:09.453743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:27:09.455487 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8256b9c4822941639662d00143e57bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8256b9c4822941639662d00143e57bf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8256b9c4822941639662d00143e57bf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8256b9c4822941639662d00143e57bf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:27:09.455487 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1786509504 Jun 16 00:27:09.455487 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: 8256b9c4822941639662d00143e57bf4 Jun 16 00:27:09.455487 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1786509504 Jun 16 00:27:09.455487 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-VolumesSnapshotsTestJSON-1786509504-project Jun 16 00:27:09.455487 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:27:09.455487 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:27:09.455487 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: 266a74e9540049eea14ea6a46052cd0e Jun 16 00:27:09.455487 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1786509504-project Jun 16 00:27:09.455487 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: Jun 16 00:27:09.455487 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Snapshot 94cc2d31-c3a7-4572-a79d-fb051b765799 could not be found. Jun 16 00:27:09.455487 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': '94cc2d31-c3a7-4572-a79d-fb051b765799'} Jun 16 00:27:09.455487 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:27:09.456115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:09.456115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 00:27:09.456115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 00:27:09.456115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 00:27:09.456115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 00:27:09.456115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 00:27:09.456115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 00:27:09.456115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:27:09.456115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:27:09.456115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:27:09.456115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:27:09.456115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:27:09.456115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:27:09.456115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:27:09.456115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:27:09.456115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 94cc2d31-c3a7-4572-a79d-fb051b765799 could not be found. (HTTP 404) (Request-ID: req-5d2b2762-de14-47d9-8124-390967d6412d) Jun 16 00:27:09.456115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:27:09.456115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:09.456961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:27:09.456961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:09.456961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 16 00:27:09.456961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 16 00:27:09.456961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:27:09.456961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:27:09.456961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 16 00:27:09.456961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 16 00:27:09.456961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:27:09.456961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:27:09.456961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 00:27:09.456961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 00:27:09.456961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 00:27:09.456961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 00:27:09.456961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 00:27:09.456961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 00:27:09.456961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:27:09.456961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:27:09.456961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:27:09.457819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:27:09.457819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:27:09.457819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:27:09.457819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:27:09.457819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:27:09.457819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 94cc2d31-c3a7-4572-a79d-fb051b765799 could not be found. Jun 16 00:27:09.457819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:27:09.457819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:09.457819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:27:09.457819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:09.457819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:09.457819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:09.457819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:27:09.457819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:27:09.457819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:27:09.457819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:27:09.457819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:27:09.457819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:27:09.457819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 16 00:27:09.457819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:27:09.458706 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 94cc2d31-c3a7-4572-a79d-fb051b765799 could not be found. Jun 16 00:27:09.458706 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:27:09.458706 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:09.458706 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:27:09.458706 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:09.458706 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:09.458706 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:09.458706 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:27:09.458706 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:27:09.458706 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 94cc2d31-c3a7-4572-a79d-fb051b765799 could not be found. Jun 16 00:27:09.458706 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:27:09.463208 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-ec9899fa-b2f8-4162-9460-e5471385637a tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Returning 404 to user: Snapshot 94cc2d31-c3a7-4572-a79d-fb051b765799 could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:27:09.470089 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-ec9899fa-b2f8-4162-9460-e5471385637a tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/94cc2d31-c3a7-4572-a79d-fb051b765799" status: 404 len: 111 microversion: 2.1 time: 0.085644 Jun 16 00:27:09.474679 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 14/29] 10.222.0.23 () {58 vars in 1250 bytes} [Thu Jun 16 00:27:09 2022] GET /compute/v2.1/os-snapshots/94cc2d31-c3a7-4572-a79d-fb051b765799 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:27:09.492328 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-e3d85692-7611-4da7-900a-308805e1e505 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Calling method '.version_select at 0x7fe7068d70d0>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:09.671786 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-e3d85692-7611-4da7-900a-308805e1e505 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/8218f987-212c-4e7d-97e2-b0a8e31294ea" status: 202 len: 0 microversion: 2.1 time: 0.192453 Jun 16 00:27:09.672345 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 15/30] 10.222.0.23 () {58 vars in 1247 bytes} [Thu Jun 16 00:27:09 2022] DELETE /compute/v2.1/os-volumes/8218f987-212c-4e7d-97e2-b0a8e31294ea => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:27:09.680302 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-038e83d4-f43e-4b73-88a6-87bb87904215 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Calling method '.version_select at 0x7fe7068d7820>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:09.721268 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-0301276b-751d-4ade-a993-7ff30fc207ef tempest-VolumesTestJSON-747968291 tempest-VolumesTestJSON-747968291-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.326406 Jun 16 00:27:09.721852 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 16/31] 10.222.0.23 () {58 vars in 1169 bytes} [Thu Jun 16 00:27:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:27:09.737423 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5fefbcde-7003-4dc2-8fe5-5fbf784a26e4 tempest-VolumesTestJSON-747968291 tempest-VolumesTestJSON-747968291-project] Calling method '.version_select at 0x7fe7068e2af0>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:09.821393 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-038e83d4-f43e-4b73-88a6-87bb87904215 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/8218f987-212c-4e7d-97e2-b0a8e31294ea" status: 200 len: 344 microversion: 2.1 time: 0.144627 Jun 16 00:27:09.822247 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 16/32] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Jun 16 00:27:09 2022] GET /compute/v2.1/os-volumes/8218f987-212c-4e7d-97e2-b0a8e31294ea => generated 344 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:27:09.963308 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-5fefbcde-7003-4dc2-8fe5-5fbf784a26e4 tempest-VolumesTestJSON-747968291 tempest-VolumesTestJSON-747968291-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.232898 Jun 16 00:27:09.964210 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 17/33] 10.222.0.23 () {58 vars in 1154 bytes} [Thu Jun 16 00:27:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:09.976779 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-2430d1cb-c843-4d1a-b5fb-19cb501532a3 tempest-VolumesTestJSON-747968291 tempest-VolumesTestJSON-747968291-project] Calling method '.version_select at 0x7fe7068d7e50>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:10.123780 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-2430d1cb-c843-4d1a-b5fb-19cb501532a3 tempest-VolumesTestJSON-747968291 tempest-VolumesTestJSON-747968291-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.150828 Jun 16 00:27:10.138152 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-53187efa-19c5-4a47-b334-5f4744799129 tempest-VolumesTestJSON-747968291 tempest-VolumesTestJSON-747968291-project] Calling method '.version_select at 0x7fe7073399d0>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:10.140266 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 17/34] 10.222.0.23 () {58 vars in 1187 bytes} [Thu Jun 16 00:27:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:10.305086 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-53187efa-19c5-4a47-b334-5f4744799129 tempest-VolumesTestJSON-747968291 tempest-VolumesTestJSON-747968291-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.171239 Jun 16 00:27:10.305647 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 18/35] 10.222.0.23 () {58 vars in 1154 bytes} [Thu Jun 16 00:27:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:10.834716 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b75392dc-5ead-4cb8-8390-5b812f87cd59 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Calling method '.version_select at 0x7fe7068d71f0>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:10.906728 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-b75392dc-5ead-4cb8-8390-5b812f87cd59 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] HTTP exception thrown: Volume 8218f987-212c-4e7d-97e2-b0a8e31294ea could not be found. Jun 16 00:27:10.913216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b75392dc-5ead-4cb8-8390-5b812f87cd59 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Request method failure captured: Jun 16 00:27:10.913216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: GET /compute/v2.1/os-volumes/8218f987-212c-4e7d-97e2-b0a8e31294ea HTTP/1.1 Jun 16 00:27:10.913216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:27:10.913216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:27:10.913216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:27:10.913216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:27:10.913216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:27:10.913216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:27:10.913216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:27:10.913216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:27:10.913216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnjT0SJQNMKXYuNT9l6hr3KGB2dM89KYMOUj8HhD_sejSzuOo3Pr8TFgT6AtYXFhHHUFklTrL4hu5JdAwz3p3eg2xBfGXP4O4-m54mwOJ13EgKdmciIhKjOB41KTT4okGanu5g4HNrvQnhkdBsZDifIztxSJv2LPV35IgSfCI22_GC0 Jun 16 00:27:10.913216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:27:10.913216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:27:10.913216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:27:10.913216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:27:10.913216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:27:10.913216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:27:10.913216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: 8256b9c4822941639662d00143e57bf4 Jun 16 00:27:10.913216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1786509504 Jun 16 00:27:10.913216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:27:10.913216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:27:10.914556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8256b9c4822941639662d00143e57bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8256b9c4822941639662d00143e57bf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8256b9c4822941639662d00143e57bf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8256b9c4822941639662d00143e57bf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:27:10.914556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1786509504 Jun 16 00:27:10.914556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: 8256b9c4822941639662d00143e57bf4 Jun 16 00:27:10.914556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1786509504 Jun 16 00:27:10.914556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-VolumesSnapshotsTestJSON-1786509504-project Jun 16 00:27:10.914556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:27:10.914556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:27:10.914556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: 266a74e9540049eea14ea6a46052cd0e Jun 16 00:27:10.914556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1786509504-project Jun 16 00:27:10.914556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: Jun 16 00:27:10.914556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Volume 8218f987-212c-4e7d-97e2-b0a8e31294ea could not be found. Jun 16 00:27:10.914556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': '8218f987-212c-4e7d-97e2-b0a8e31294ea'} Jun 16 00:27:10.914556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:27:10.915968 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:10.915968 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:27:10.915968 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:27:10.915968 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:27:10.915968 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:27:10.915968 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:27:10.915968 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:27:10.915968 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:27:10.915968 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:27:10.915968 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:27:10.915968 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:27:10.915968 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:27:10.915968 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:27:10.915968 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:27:10.915968 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:27:10.915968 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8218f987-212c-4e7d-97e2-b0a8e31294ea could not be found. (HTTP 404) (Request-ID: req-8487aa34-978c-400f-b9be-e2f79e375660) Jun 16 00:27:10.915968 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:27:10.915968 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:10.915968 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:27:10.917254 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:10.917254 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 00:27:10.917254 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 00:27:10.917254 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:27:10.917254 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:27:10.917254 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 00:27:10.917254 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 00:27:10.917254 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:27:10.917254 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:27:10.917254 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:27:10.917254 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:27:10.917254 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:27:10.917254 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:27:10.917254 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:27:10.917254 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:27:10.917254 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:27:10.917254 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:27:10.917254 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:27:10.917254 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:27:10.918372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:27:10.918372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:27:10.918372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:27:10.918372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:27:10.918372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8218f987-212c-4e7d-97e2-b0a8e31294ea could not be found. Jun 16 00:27:10.918372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:27:10.918372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:10.918372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:27:10.918372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:10.918372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:10.918372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:10.918372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:27:10.918372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:27:10.918372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:27:10.918372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:27:10.918372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:27:10.918372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:27:10.918372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 00:27:10.918372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:27:10.919428 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8218f987-212c-4e7d-97e2-b0a8e31294ea could not be found. Jun 16 00:27:10.919428 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:27:10.919428 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:10.919428 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:27:10.919428 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:10.919428 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:10.919428 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:10.919428 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:27:10.919428 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:27:10.919428 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8218f987-212c-4e7d-97e2-b0a8e31294ea could not be found. Jun 16 00:27:10.919428 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:27:10.923548 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b75392dc-5ead-4cb8-8390-5b812f87cd59 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Returning 404 to user: Volume 8218f987-212c-4e7d-97e2-b0a8e31294ea could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:27:10.924559 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-b75392dc-5ead-4cb8-8390-5b812f87cd59 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/8218f987-212c-4e7d-97e2-b0a8e31294ea" status: 404 len: 109 microversion: 2.1 time: 0.094074 Jun 16 00:27:10.925635 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 18/36] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Jun 16 00:27:10 2022] GET /compute/v2.1/os-volumes/8218f987-212c-4e7d-97e2-b0a8e31294ea => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:27:10.941294 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-863fd444-1842-4d70-903d-03036379edb5 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Calling method '.version_select at 0x7fe7068e69d0>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:10.993654 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-863fd444-1842-4d70-903d-03036379edb5 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] HTTP exception thrown: Volume 8218f987-212c-4e7d-97e2-b0a8e31294ea could not be found. Jun 16 00:27:10.995799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-863fd444-1842-4d70-903d-03036379edb5 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Request method failure captured: Jun 16 00:27:10.995799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: DELETE /compute/v2.1/os-volumes/8218f987-212c-4e7d-97e2-b0a8e31294ea HTTP/1.1 Jun 16 00:27:10.995799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:27:10.995799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:27:10.995799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:27:10.995799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:27:10.995799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:27:10.995799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:27:10.995799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:27:10.995799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:27:10.995799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnjT0SJQNMKXYuNT9l6hr3KGB2dM89KYMOUj8HhD_sejSzuOo3Pr8TFgT6AtYXFhHHUFklTrL4hu5JdAwz3p3eg2xBfGXP4O4-m54mwOJ13EgKdmciIhKjOB41KTT4okGanu5g4HNrvQnhkdBsZDifIztxSJv2LPV35IgSfCI22_GC0 Jun 16 00:27:10.995799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:27:10.995799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:27:10.995799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:27:10.995799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:27:10.995799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:27:10.995799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:27:10.995799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: 8256b9c4822941639662d00143e57bf4 Jun 16 00:27:10.995799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1786509504 Jun 16 00:27:10.995799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:27:10.995799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:27:10.997094 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8256b9c4822941639662d00143e57bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8256b9c4822941639662d00143e57bf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8256b9c4822941639662d00143e57bf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8256b9c4822941639662d00143e57bf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:27:10.997094 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1786509504 Jun 16 00:27:10.997094 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: 8256b9c4822941639662d00143e57bf4 Jun 16 00:27:10.997094 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1786509504 Jun 16 00:27:10.997094 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-VolumesSnapshotsTestJSON-1786509504-project Jun 16 00:27:10.997094 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:27:10.997094 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:27:10.997094 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: 266a74e9540049eea14ea6a46052cd0e Jun 16 00:27:10.997094 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1786509504-project Jun 16 00:27:10.997094 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: Jun 16 00:27:10.997094 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Volume 8218f987-212c-4e7d-97e2-b0a8e31294ea could not be found. Jun 16 00:27:10.997094 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'id': '8218f987-212c-4e7d-97e2-b0a8e31294ea'} Jun 16 00:27:10.997094 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:27:10.997916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:10.997916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:27:10.997916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:27:10.997916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 00:27:10.997916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 00:27:10.997916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 00:27:10.997916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 00:27:10.997916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 00:27:10.997916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 00:27:10.997916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 00:27:10.997916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 00:27:10.997916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:27:10.997916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:27:10.997916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:27:10.997916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:27:10.997916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8218f987-212c-4e7d-97e2-b0a8e31294ea could not be found. (HTTP 404) (Request-ID: req-dd4e1d97-d9d4-407f-a657-69efcf5f9cb3) Jun 16 00:27:10.997916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:27:10.997916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:10.997916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:27:10.999475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:10.999475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 00:27:10.999475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 00:27:10.999475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:27:10.999475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:27:10.999475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 00:27:10.999475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 00:27:10.999475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:27:10.999475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:27:10.999475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:27:10.999475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:27:10.999475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 00:27:10.999475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 00:27:10.999475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 00:27:10.999475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 00:27:10.999475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 00:27:10.999475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 00:27:10.999475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 00:27:10.999475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 00:27:11.000406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:27:11.000406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:27:11.000406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:27:11.000406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:27:11.000406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8218f987-212c-4e7d-97e2-b0a8e31294ea could not be found. Jun 16 00:27:11.000406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:27:11.000406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:11.000406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:27:11.000406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:11.000406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:11.000406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:11.000406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:27:11.000406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:27:11.000406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:27:11.000406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:27:11.000406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:27:11.000406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:27:11.000406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 00:27:11.000406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:27:11.001546 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8218f987-212c-4e7d-97e2-b0a8e31294ea could not be found. Jun 16 00:27:11.001546 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:27:11.001546 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:11.001546 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:27:11.001546 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:11.001546 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:11.001546 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:11.001546 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:27:11.001546 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:27:11.001546 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8218f987-212c-4e7d-97e2-b0a8e31294ea could not be found. Jun 16 00:27:11.001546 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:27:11.003691 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-863fd444-1842-4d70-903d-03036379edb5 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Returning 404 to user: Volume 8218f987-212c-4e7d-97e2-b0a8e31294ea could not be found. {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:27:11.004697 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-863fd444-1842-4d70-903d-03036379edb5 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/8218f987-212c-4e7d-97e2-b0a8e31294ea" status: 404 len: 109 microversion: 2.1 time: 0.068027 Jun 16 00:27:11.005439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 19/37] 10.222.0.23 () {58 vars in 1247 bytes} [Thu Jun 16 00:27:10 2022] DELETE /compute/v2.1/os-volumes/8218f987-212c-4e7d-97e2-b0a8e31294ea => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 00:27:11.014397 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-efca5a08-6d9b-4909-bfd0-450227d79a78 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Calling method '.version_select at 0x7fe7068dc790>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:11.070345 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-efca5a08-6d9b-4909-bfd0-450227d79a78 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] HTTP exception thrown: Volume 8218f987-212c-4e7d-97e2-b0a8e31294ea could not be found. Jun 16 00:27:11.075116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-efca5a08-6d9b-4909-bfd0-450227d79a78 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Request method failure captured: Jun 16 00:27:11.075116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: GET /compute/v2.1/os-volumes/8218f987-212c-4e7d-97e2-b0a8e31294ea HTTP/1.1 Jun 16 00:27:11.075116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:27:11.075116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:27:11.075116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:27:11.075116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:27:11.075116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:27:11.075116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:27:11.075116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:27:11.075116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:27:11.075116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnjT0SJQNMKXYuNT9l6hr3KGB2dM89KYMOUj8HhD_sejSzuOo3Pr8TFgT6AtYXFhHHUFklTrL4hu5JdAwz3p3eg2xBfGXP4O4-m54mwOJ13EgKdmciIhKjOB41KTT4okGanu5g4HNrvQnhkdBsZDifIztxSJv2LPV35IgSfCI22_GC0 Jun 16 00:27:11.075116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:27:11.075116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:27:11.075116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:27:11.075116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:27:11.075116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:27:11.075116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:27:11.075116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: 8256b9c4822941639662d00143e57bf4 Jun 16 00:27:11.075116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1786509504 Jun 16 00:27:11.075116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:27:11.075116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:27:11.076290 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8256b9c4822941639662d00143e57bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8256b9c4822941639662d00143e57bf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8256b9c4822941639662d00143e57bf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8256b9c4822941639662d00143e57bf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:27:11.076290 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1786509504 Jun 16 00:27:11.076290 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: 8256b9c4822941639662d00143e57bf4 Jun 16 00:27:11.076290 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1786509504 Jun 16 00:27:11.076290 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-VolumesSnapshotsTestJSON-1786509504-project Jun 16 00:27:11.076290 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:27:11.076290 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:27:11.076290 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: 266a74e9540049eea14ea6a46052cd0e Jun 16 00:27:11.076290 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1786509504-project Jun 16 00:27:11.076290 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: Jun 16 00:27:11.076290 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Volume 8218f987-212c-4e7d-97e2-b0a8e31294ea could not be found. Jun 16 00:27:11.076290 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': '8218f987-212c-4e7d-97e2-b0a8e31294ea'} Jun 16 00:27:11.076290 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:27:11.077030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:11.077030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:27:11.077030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:27:11.077030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:27:11.077030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:27:11.077030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:27:11.077030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:27:11.077030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:27:11.077030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:27:11.077030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:27:11.077030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:27:11.077030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:27:11.077030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:27:11.077030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:27:11.077030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:27:11.077030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8218f987-212c-4e7d-97e2-b0a8e31294ea could not be found. (HTTP 404) (Request-ID: req-1e4e8637-5f79-4527-9e93-d48c99d6d017) Jun 16 00:27:11.077030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:27:11.077030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:11.077030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:27:11.078032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:11.078032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 00:27:11.078032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 00:27:11.078032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:27:11.078032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:27:11.078032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 00:27:11.078032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 00:27:11.078032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:27:11.078032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:27:11.078032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:27:11.078032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:27:11.078032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:27:11.078032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:27:11.078032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:27:11.078032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:27:11.078032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:27:11.078032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:27:11.078032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:27:11.078032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:27:11.082202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:27:11.082202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:27:11.082202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:27:11.082202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:27:11.082202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8218f987-212c-4e7d-97e2-b0a8e31294ea could not be found. Jun 16 00:27:11.082202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:27:11.082202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:11.082202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:27:11.082202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:11.082202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:11.082202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:11.082202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:27:11.082202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:27:11.082202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:27:11.082202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:27:11.082202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:27:11.082202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:27:11.082202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 00:27:11.082202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:27:11.083490 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8218f987-212c-4e7d-97e2-b0a8e31294ea could not be found. Jun 16 00:27:11.083490 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:27:11.083490 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:11.083490 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:27:11.083490 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:11.083490 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:11.083490 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:11.083490 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:27:11.083490 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:27:11.083490 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8218f987-212c-4e7d-97e2-b0a8e31294ea could not be found. Jun 16 00:27:11.083490 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:27:11.083490 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-efca5a08-6d9b-4909-bfd0-450227d79a78 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] Returning 404 to user: Volume 8218f987-212c-4e7d-97e2-b0a8e31294ea could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:27:11.083490 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-efca5a08-6d9b-4909-bfd0-450227d79a78 tempest-VolumesSnapshotsTestJSON-1786509504 tempest-VolumesSnapshotsTestJSON-1786509504-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/8218f987-212c-4e7d-97e2-b0a8e31294ea" status: 404 len: 109 microversion: 2.1 time: 0.066737 Jun 16 00:27:11.083490 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 19/38] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Jun 16 00:27:11 2022] GET /compute/v2.1/os-volumes/8218f987-212c-4e7d-97e2-b0a8e31294ea => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:27:13.966230 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d5bfb49e-dca8-4468-874f-c651552f9dfe tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1204039127", "imageRef": "d9a6de24-7a5e-4f8b-b078-809c87b15d56", "flavorRef": "452", "networks": [{"uuid": "5f2cc6e2-7bf8-4917-83f0-5a3f2f35e6fa"}]}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:14.202820 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.network.neutron [None req-d5bfb49e-dca8-4468-874f-c651552f9dfe tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] validate_networks() for [('5f2cc6e2-7bf8-4917-83f0-5a3f2f35e6fa', None, None, None, None, None)] {{(pid=124230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:27:17.139603 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-d5bfb49e-dca8-4468-874f-c651552f9dfe tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Flavor limits 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:27:17.140727 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-d5bfb49e-dca8-4468-874f-c651552f9dfe tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Image limits 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:27:17.141495 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-d5bfb49e-dca8-4468-874f-c651552f9dfe tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Flavor pref 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:27:17.142121 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-d5bfb49e-dca8-4468-874f-c651552f9dfe tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Image pref 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:27:17.142709 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-d5bfb49e-dca8-4468-874f-c651552f9dfe tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:27:17.164802 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d5bfb49e-dca8-4468-874f-c651552f9dfe tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:17.165564 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d5bfb49e-dca8-4468-874f-c651552f9dfe tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:17.167111 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d5bfb49e-dca8-4468-874f-c651552f9dfe tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:17.167694 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d5bfb49e-dca8-4468-874f-c651552f9dfe tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:17.265672 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-d5bfb49e-dca8-4468-874f-c651552f9dfe tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Getting quotas for project 7e7ced4b21544bd689b6b0cae01566b6. Resources: {'ram', 'cores', 'instances'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:27:17.287601 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-d5bfb49e-dca8-4468-874f-c651552f9dfe tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Getting quotas for user 01c74d394beb4d7286563fc4a9687d50 and project 7e7ced4b21544bd689b6b0cae01566b6. Resources: {'ram', 'cores', 'instances'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:27:17.342633 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d5bfb49e-dca8-4468-874f-c651552f9dfe tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Going to run 1 instances... {{(pid=124230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:27:17.347333 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d5bfb49e-dca8-4468-874f-c651552f9dfe tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d9a6de24-7a5e-4f8b-b078-809c87b15d56',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:27:17.482972 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d5bfb49e-dca8-4468-874f-c651552f9dfe tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.829258 Jun 16 00:27:17.483918 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 20/39] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Jun 16 00:27:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:27:17.497096 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-ff088941-0384-4ee5-b713-7bd236ce3b18 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:17.497723 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-ff088941-0384-4ee5-b713-7bd236ce3b18 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:17.609505 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-6fba94e5-bbce-4a6a-b5e6-c3047303d396 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Action: 'create', calling method: .version_select at 0x7fe7068d7310>, body: {"keypair": {"name": "tempest-keypair-802527258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAdkkrav1xjUA+sed0fsllkKVjFHMalfNRpXsXn64jDixN0AvwEpGvuZXhtcAJNS1O/EEGlxTUSsqk189bV83Ovjjw1HsWuVFPfRMrq2+zgc5QzyVew8u5byoqX5a/j9A=="}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:17.682693 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-ff088941-0384-4ee5-b713-7bd236ce3b18 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:17.713571 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-6fba94e5-bbce-4a6a-b5e6-c3047303d396 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Getting quotas for project cd8526627add42a597eff6fce7400885. Resources: {'key_pairs'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:27:17.714863 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-ff088941-0384-4ee5-b713-7bd236ce3b18 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1215 microversion: 2.1 time: 0.224752 Jun 16 00:27:17.715915 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 21/40] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:17 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1215 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:17.731483 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-6fba94e5-bbce-4a6a-b5e6-c3047303d396 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Getting quotas for user f1d7bb8f9d364c5198313fedd982478a and project cd8526627add42a597eff6fce7400885. Resources: {'key_pairs'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:27:17.849487 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-6fba94e5-bbce-4a6a-b5e6-c3047303d396 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.125743 Jun 16 00:27:17.850577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 20/41] 10.222.0.23 () {62 vars in 1199 bytes} [Thu Jun 16 00:27:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 00:27:18.735700 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-3b958572-dd50-4671-a219-08d3428b8005 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:18.736409 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-3b958572-dd50-4671-a219-08d3428b8005 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:19.096832 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-3b958572-dd50-4671-a219-08d3428b8005 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:19.136506 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-3b958572-dd50-4671-a219-08d3428b8005 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1215 microversion: 2.1 time: 0.402349 Jun 16 00:27:19.151512 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 21/42] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:18 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1215 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:19.773958 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-a7068d7d-36e2-4295-8273-09658877392b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1621189933", "imageRef": "d9a6de24-7a5e-4f8b-b078-809c87b15d56", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:19.900966 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.network.neutron [None req-a7068d7d-36e2-4295-8273-09658877392b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] validate_networks() for [('256025e5-4dfc-4eb0-8191-836be075779a', None, None, None, None, None)] {{(pid=124230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:27:20.157483 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-db5d3c88-3350-4f0d-8edc-8aeb2f3cd4ba tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:20.158943 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-db5d3c88-3350-4f0d-8edc-8aeb2f3cd4ba tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:20.176471 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-db5d3c88-3350-4f0d-8edc-8aeb2f3cd4ba tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:20.176906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-db5d3c88-3350-4f0d-8edc-8aeb2f3cd4ba tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:20.177686 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-db5d3c88-3350-4f0d-8edc-8aeb2f3cd4ba tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:20.178125 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-db5d3c88-3350-4f0d-8edc-8aeb2f3cd4ba tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:20.819347 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-db5d3c88-3350-4f0d-8edc-8aeb2f3cd4ba tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:20.852794 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-db5d3c88-3350-4f0d-8edc-8aeb2f3cd4ba tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1219 microversion: 2.1 time: 0.696052 Jun 16 00:27:20.861920 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 22/43] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:20 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1219 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:21.044787 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-a7068d7d-36e2-4295-8273-09658877392b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Flavor limits 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:27:21.045592 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-a7068d7d-36e2-4295-8273-09658877392b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Image limits 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:27:21.046088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-a7068d7d-36e2-4295-8273-09658877392b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Flavor pref 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:27:21.046562 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-a7068d7d-36e2-4295-8273-09658877392b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Image pref 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:27:21.047049 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-a7068d7d-36e2-4295-8273-09658877392b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:27:21.075479 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a7068d7d-36e2-4295-8273-09658877392b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:21.076155 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a7068d7d-36e2-4295-8273-09658877392b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:21.084988 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a7068d7d-36e2-4295-8273-09658877392b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:21.086135 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a7068d7d-36e2-4295-8273-09658877392b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:21.153237 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-a7068d7d-36e2-4295-8273-09658877392b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Getting quotas for project 0e5f17f8ba8e4113a27a004ebb29917a. Resources: {'ram', 'cores', 'instances'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:27:21.165293 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-a7068d7d-36e2-4295-8273-09658877392b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Getting quotas for user b5f4125ecaec41e5ba5c4eaf00c43e07 and project 0e5f17f8ba8e4113a27a004ebb29917a. Resources: {'ram', 'cores', 'instances'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:27:21.194755 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-a7068d7d-36e2-4295-8273-09658877392b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Going to run 1 instances... {{(pid=124230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:27:21.201488 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-a7068d7d-36e2-4295-8273-09658877392b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d9a6de24-7a5e-4f8b-b078-809c87b15d56',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:27:21.309077 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-a7068d7d-36e2-4295-8273-09658877392b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.842734 Jun 16 00:27:21.315111 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 22/44] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Jun 16 00:27:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 2850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:27:21.321888 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-173425a5-b9b2-4acb-8f0d-ef522d472a05 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:21.324728 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-173425a5-b9b2-4acb-8f0d-ef522d472a05 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:21.614088 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-173425a5-b9b2-4acb-8f0d-ef522d472a05 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:21.627915 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-173425a5-b9b2-4acb-8f0d-ef522d472a05 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1222 microversion: 2.1 time: 0.311733 Jun 16 00:27:21.628500 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 23/45] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:21 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1222 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:21.884153 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-34572454-ce86-4772-8763-9f32fc55296a tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:21.898100 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-34572454-ce86-4772-8763-9f32fc55296a tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:21.926604 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-34572454-ce86-4772-8763-9f32fc55296a tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:21.929398 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-34572454-ce86-4772-8763-9f32fc55296a tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:21.931020 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-34572454-ce86-4772-8763-9f32fc55296a tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:21.933698 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-34572454-ce86-4772-8763-9f32fc55296a tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:22.325758 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-dc96dfb1-5b4b-4c21-b103-2720ba559ba7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1903695722", "imageRef": "d9a6de24-7a5e-4f8b-b078-809c87b15d56", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:22.436775 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-34572454-ce86-4772-8763-9f32fc55296a tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:22.494556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.network.neutron [None req-dc96dfb1-5b4b-4c21-b103-2720ba559ba7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] validate_networks() for [('256025e5-4dfc-4eb0-8191-836be075779a', None, None, None, None, None)] {{(pid=124231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:27:22.495377 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-34572454-ce86-4772-8763-9f32fc55296a tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1273 microversion: 2.1 time: 0.619338 Jun 16 00:27:22.498220 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 23/46] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:21 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1273 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:23.456664 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d79568fe-34ed-4bee-ad1c-470ee0ceda59 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-432413030", "imageRef": "d9a6de24-7a5e-4f8b-b078-809c87b15d56", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc84a00d-15c4-4773-9b21-ea4524d0b0d5"}], "security_groups": [{"name": "tempest-securitygroup--1830745987"}], "key_name": "tempest-keypair-802527258", "user_data": "}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:23.693553 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.network.neutron [None req-d79568fe-34ed-4bee-ad1c-470ee0ceda59 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] validate_networks() for [('dc84a00d-15c4-4773-9b21-ea4524d0b0d5', None, None, None, None, None)] {{(pid=124230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:27:25.156789 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-d79568fe-34ed-4bee-ad1c-470ee0ceda59 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Flavor limits 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:27:25.158166 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-d79568fe-34ed-4bee-ad1c-470ee0ceda59 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Image limits 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:27:25.158950 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-d79568fe-34ed-4bee-ad1c-470ee0ceda59 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Flavor pref 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:27:25.159614 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-d79568fe-34ed-4bee-ad1c-470ee0ceda59 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Image pref 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:27:25.160210 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-d79568fe-34ed-4bee-ad1c-470ee0ceda59 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:27:25.176164 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d79568fe-34ed-4bee-ad1c-470ee0ceda59 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:25.178564 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d79568fe-34ed-4bee-ad1c-470ee0ceda59 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:25.179571 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d79568fe-34ed-4bee-ad1c-470ee0ceda59 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:25.182935 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d79568fe-34ed-4bee-ad1c-470ee0ceda59 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:25.237471 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-d79568fe-34ed-4bee-ad1c-470ee0ceda59 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Getting quotas for project cd8526627add42a597eff6fce7400885. Resources: {'ram', 'cores', 'instances'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:27:25.248825 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-d79568fe-34ed-4bee-ad1c-470ee0ceda59 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Getting quotas for user f1d7bb8f9d364c5198313fedd982478a and project cd8526627add42a597eff6fce7400885. Resources: {'ram', 'cores', 'instances'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:27:25.302988 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d79568fe-34ed-4bee-ad1c-470ee0ceda59 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Going to run 1 instances... {{(pid=124230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:27:25.309781 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d79568fe-34ed-4bee-ad1c-470ee0ceda59 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d9a6de24-7a5e-4f8b-b078-809c87b15d56',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:27:25.511007 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d79568fe-34ed-4bee-ad1c-470ee0ceda59 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.057933 Jun 16 00:27:25.512483 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 24/47] 10.222.0.23 () {62 vars in 1187 bytes} [Thu Jun 16 00:27:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 2061 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 16 00:27:25.525191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b8aaa637-00dc-48f1-87e2-60ad752ae6fc tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:25.526844 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-b8aaa637-00dc-48f1-87e2-60ad752ae6fc tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:25.545901 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b8aaa637-00dc-48f1-87e2-60ad752ae6fc tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:25.547320 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b8aaa637-00dc-48f1-87e2-60ad752ae6fc tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:25.552786 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b8aaa637-00dc-48f1-87e2-60ad752ae6fc tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:25.554565 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b8aaa637-00dc-48f1-87e2-60ad752ae6fc tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:26.415161 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b8aaa637-00dc-48f1-87e2-60ad752ae6fc tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:26.425653 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-b8aaa637-00dc-48f1-87e2-60ad752ae6fc tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1315 microversion: 2.1 time: 0.909114 Jun 16 00:27:26.428193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 25/48] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:25 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1315 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:26.457139 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-df72ea0f-5b5b-4a79-8cda-bedb3ec37252 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:26.462537 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-df72ea0f-5b5b-4a79-8cda-bedb3ec37252 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:28.168341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-df72ea0f-5b5b-4a79-8cda-bedb3ec37252 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:28.176050 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-df72ea0f-5b5b-4a79-8cda-bedb3ec37252 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:28.177601 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-df72ea0f-5b5b-4a79-8cda-bedb3ec37252 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:28.186885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-df72ea0f-5b5b-4a79-8cda-bedb3ec37252 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1280 microversion: 2.20 time: 1.736021 Jun 16 00:27:28.188997 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 26/49] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:26 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1280 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:28.217266 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-4b5f7470-e039-4050-8418-14e528bc8e8b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:28.218354 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-4b5f7470-e039-4050-8418-14e528bc8e8b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:28.227612 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4b5f7470-e039-4050-8418-14e528bc8e8b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:28.242727 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4b5f7470-e039-4050-8418-14e528bc8e8b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:28.243939 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4b5f7470-e039-4050-8418-14e528bc8e8b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:28.244587 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4b5f7470-e039-4050-8418-14e528bc8e8b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:28.285541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-dc96dfb1-5b4b-4c21-b103-2720ba559ba7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Flavor limits 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:27:28.286778 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-dc96dfb1-5b4b-4c21-b103-2720ba559ba7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Image limits 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:27:28.287477 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-dc96dfb1-5b4b-4c21-b103-2720ba559ba7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Flavor pref 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:27:28.288105 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-dc96dfb1-5b4b-4c21-b103-2720ba559ba7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Image pref 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:27:28.288747 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-dc96dfb1-5b4b-4c21-b103-2720ba559ba7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:27:28.307854 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-dc96dfb1-5b4b-4c21-b103-2720ba559ba7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:28.308328 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-dc96dfb1-5b4b-4c21-b103-2720ba559ba7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:28.312217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-dc96dfb1-5b4b-4c21-b103-2720ba559ba7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:28.326025 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-dc96dfb1-5b4b-4c21-b103-2720ba559ba7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:28.485672 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-dc96dfb1-5b4b-4c21-b103-2720ba559ba7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Getting quotas for project 0e5f17f8ba8e4113a27a004ebb29917a. Resources: {'ram', 'cores', 'instances'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:27:28.500478 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-dc96dfb1-5b4b-4c21-b103-2720ba559ba7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Getting quotas for user b5f4125ecaec41e5ba5c4eaf00c43e07 and project 0e5f17f8ba8e4113a27a004ebb29917a. Resources: {'ram', 'cores', 'instances'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:27:28.558783 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-dc96dfb1-5b4b-4c21-b103-2720ba559ba7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Going to run 1 instances... {{(pid=124231) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:27:28.570766 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-dc96dfb1-5b4b-4c21-b103-2720ba559ba7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d9a6de24-7a5e-4f8b-b078-809c87b15d56',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:27:28.839581 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-dc96dfb1-5b4b-4c21-b103-2720ba559ba7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.519201 Jun 16 00:27:28.841033 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 24/50] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Jun 16 00:27:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 6521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 00:27:28.859346 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-7fc86141-a3b2-44d0-923c-993e6b097a6d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:28.859954 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-7fc86141-a3b2-44d0-923c-993e6b097a6d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:28.865568 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-4b5f7470-e039-4050-8418-14e528bc8e8b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:28.876823 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-4b5f7470-e039-4050-8418-14e528bc8e8b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1315 microversion: 2.1 time: 0.686319 Jun 16 00:27:28.892777 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 27/51] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:28 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:29.046527 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-7fc86141-a3b2-44d0-923c-993e6b097a6d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:29.064009 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-7fc86141-a3b2-44d0-923c-993e6b097a6d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1222 microversion: 2.1 time: 0.213321 Jun 16 00:27:29.066872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 25/52] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:28 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1222 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:29.207638 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8563a3c2-46c8-47d5-8739-e953975868ca tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:29.208249 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-8563a3c2-46c8-47d5-8739-e953975868ca tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:29.226759 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8563a3c2-46c8-47d5-8739-e953975868ca tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:29.231607 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8563a3c2-46c8-47d5-8739-e953975868ca tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:29.232780 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8563a3c2-46c8-47d5-8739-e953975868ca tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:29.233961 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8563a3c2-46c8-47d5-8739-e953975868ca tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:29.575636 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-8563a3c2-46c8-47d5-8739-e953975868ca tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:29.607212 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-8563a3c2-46c8-47d5-8739-e953975868ca tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:29.613023 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-8563a3c2-46c8-47d5-8739-e953975868ca tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:29.614686 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-8563a3c2-46c8-47d5-8739-e953975868ca tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1338 microversion: 2.20 time: 0.411370 Jun 16 00:27:29.616173 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 28/53] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:29 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1338 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:29.895681 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-3907cfd4-8195-4619-8bd8-a3d9326655de tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:29.897458 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-3907cfd4-8195-4619-8bd8-a3d9326655de tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:29.923760 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3907cfd4-8195-4619-8bd8-a3d9326655de tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:29.929522 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3907cfd4-8195-4619-8bd8-a3d9326655de tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:29.932525 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3907cfd4-8195-4619-8bd8-a3d9326655de tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:29.933063 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3907cfd4-8195-4619-8bd8-a3d9326655de tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:30.084416 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-ad5c325f-213f-4af8-93db-4e1b08736ee2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:30.085081 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-ad5c325f-213f-4af8-93db-4e1b08736ee2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:30.105193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ad5c325f-213f-4af8-93db-4e1b08736ee2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:30.107172 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ad5c325f-213f-4af8-93db-4e1b08736ee2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:30.110952 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ad5c325f-213f-4af8-93db-4e1b08736ee2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:30.116678 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ad5c325f-213f-4af8-93db-4e1b08736ee2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:30.982510 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-ad5c325f-213f-4af8-93db-4e1b08736ee2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:31.005114 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-ad5c325f-213f-4af8-93db-4e1b08736ee2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1218 microversion: 2.1 time: 0.914802 Jun 16 00:27:31.014292 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 29/54] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:30 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1218 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:31.057277 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-bb33cca4-cf94-411f-ac80-ae3b221e63eb tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:31.063696 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-bb33cca4-cf94-411f-ac80-ae3b221e63eb tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:31.098198 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bb33cca4-cf94-411f-ac80-ae3b221e63eb tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:31.108070 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bb33cca4-cf94-411f-ac80-ae3b221e63eb tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:31.112289 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bb33cca4-cf94-411f-ac80-ae3b221e63eb tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:31.117425 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bb33cca4-cf94-411f-ac80-ae3b221e63eb tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:31.744393 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-bb33cca4-cf94-411f-ac80-ae3b221e63eb tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:31.765669 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-bb33cca4-cf94-411f-ac80-ae3b221e63eb tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:31.767187 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-bb33cca4-cf94-411f-ac80-ae3b221e63eb tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:31.768336 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-bb33cca4-cf94-411f-ac80-ae3b221e63eb tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1338 microversion: 2.20 time: 0.752254 Jun 16 00:27:31.768950 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 30/55] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:31 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1338 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:32.097577 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-bb5a14ab-375d-440a-a90b-49fa24405648 req-0e042e0c-e572-45e6-8f52-99b1c187c6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3d3e518-8904-49a1-82d2-c59a7ab09acf", "tag": "0f60693e-4470-4a5b-b3e8-6439aa2de3f0"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:32.117188 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-bb5a14ab-375d-440a-a90b-49fa24405648 req-0e042e0c-e572-45e6-8f52-99b1c187c6b4 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:32.118095 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-bb5a14ab-375d-440a-a90b-49fa24405648 req-0e042e0c-e572-45e6-8f52-99b1c187c6b4 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:32.140943 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-bb5a14ab-375d-440a-a90b-49fa24405648 req-0e042e0c-e572-45e6-8f52-99b1c187c6b4 service nova] Creating event network-changed:0f60693e-4470-4a5b-b3e8-6439aa2de3f0 for instance a3d3e518-8904-49a1-82d2-c59a7ab09acf on hv-cinder-84599 Jun 16 00:27:32.141672 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-bb5a14ab-375d-440a-a90b-49fa24405648 req-0e042e0c-e572-45e6-8f52-99b1c187c6b4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124230) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 00:27:32.143260 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-aa37089d-07a6-47b0-ae24-7e2e2d99071b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:32.143867 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-aa37089d-07a6-47b0-ae24-7e2e2d99071b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:32.145088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-aa37089d-07a6-47b0-ae24-7e2e2d99071b None None] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:32.145765 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-aa37089d-07a6-47b0-ae24-7e2e2d99071b None None] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:32.157866 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.compute.rpcapi [None req-aa37089d-07a6-47b0-ae24-7e2e2d99071b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 00:27:32.158984 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-aa37089d-07a6-47b0-ae24-7e2e2d99071b None None] Releasing lock "compute-rpcapi-router" {{(pid=124230) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 00:27:32.210536 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-aa37089d-07a6-47b0-ae24-7e2e2d99071b None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.440226 Jun 16 00:27:32.213228 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 31/56] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:32.220503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-80b5239c-5a94-4c16-9763-aa56c705b31c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:32.222835 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-80b5239c-5a94-4c16-9763-aa56c705b31c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:32.243232 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-80b5239c-5a94-4c16-9763-aa56c705b31c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:32.244584 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-80b5239c-5a94-4c16-9763-aa56c705b31c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:32.248200 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-80b5239c-5a94-4c16-9763-aa56c705b31c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:32.248825 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-80b5239c-5a94-4c16-9763-aa56c705b31c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:32.409088 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-3907cfd4-8195-4619-8bd8-a3d9326655de tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:32.439783 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-3907cfd4-8195-4619-8bd8-a3d9326655de tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1315 microversion: 2.1 time: 2.546777 Jun 16 00:27:32.461612 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 26/57] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:29 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1315 bytes in 2571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:32.627015 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-80b5239c-5a94-4c16-9763-aa56c705b31c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:32.640181 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-80b5239c-5a94-4c16-9763-aa56c705b31c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1280 microversion: 2.1 time: 0.425637 Jun 16 00:27:32.641029 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 32/58] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:32 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1280 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:32.788668 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-6cf73609-890c-4db2-a7aa-8d47930c8aa6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:32.809136 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-6cf73609-890c-4db2-a7aa-8d47930c8aa6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:32.809136 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6cf73609-890c-4db2-a7aa-8d47930c8aa6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:32.809136 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6cf73609-890c-4db2-a7aa-8d47930c8aa6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:32.809136 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6cf73609-890c-4db2-a7aa-8d47930c8aa6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:32.810124 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6cf73609-890c-4db2-a7aa-8d47930c8aa6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:33.278730 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-6cf73609-890c-4db2-a7aa-8d47930c8aa6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:33.287039 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-6cf73609-890c-4db2-a7aa-8d47930c8aa6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:33.288658 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-6cf73609-890c-4db2-a7aa-8d47930c8aa6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:33.301337 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-6cf73609-890c-4db2-a7aa-8d47930c8aa6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1338 microversion: 2.20 time: 0.514233 Jun 16 00:27:33.313878 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 27/59] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:32 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1338 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:33.463407 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-ba766f15-b6b6-423b-b770-88ce440cd6d9 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:33.464064 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-ba766f15-b6b6-423b-b770-88ce440cd6d9 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:33.478274 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ba766f15-b6b6-423b-b770-88ce440cd6d9 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:33.478730 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ba766f15-b6b6-423b-b770-88ce440cd6d9 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:33.493340 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ba766f15-b6b6-423b-b770-88ce440cd6d9 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:33.494170 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ba766f15-b6b6-423b-b770-88ce440cd6d9 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:34.046380 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-703bdd46-5d0f-4a0e-9c3f-c19581c3971f req-4303d85b-c553-43fe-899a-73dff251b7c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0", "tag": "706dd94f-c3cb-40fa-a55b-a032e4c5f87b"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:34.063500 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-703bdd46-5d0f-4a0e-9c3f-c19581c3971f req-4303d85b-c553-43fe-899a-73dff251b7c5 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:34.063955 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-703bdd46-5d0f-4a0e-9c3f-c19581c3971f req-4303d85b-c553-43fe-899a-73dff251b7c5 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:34.128597 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-703bdd46-5d0f-4a0e-9c3f-c19581c3971f req-4303d85b-c553-43fe-899a-73dff251b7c5 service nova] Creating event network-changed:706dd94f-c3cb-40fa-a55b-a032e4c5f87b for instance c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 on hv-cinder-84599 Jun 16 00:27:34.147934 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-703bdd46-5d0f-4a0e-9c3f-c19581c3971f req-4303d85b-c553-43fe-899a-73dff251b7c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.922888 Jun 16 00:27:34.159870 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 33/60] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:34.177475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-ebae3bbf-5cf1-4b10-bcdd-1bcd00690374 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:34.189447 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-ebae3bbf-5cf1-4b10-bcdd-1bcd00690374 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:34.215094 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ebae3bbf-5cf1-4b10-bcdd-1bcd00690374 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:34.220661 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ebae3bbf-5cf1-4b10-bcdd-1bcd00690374 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:34.231701 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ebae3bbf-5cf1-4b10-bcdd-1bcd00690374 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:34.234623 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ebae3bbf-5cf1-4b10-bcdd-1bcd00690374 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:34.516296 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-ba766f15-b6b6-423b-b770-88ce440cd6d9 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:34.528387 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-ba766f15-b6b6-423b-b770-88ce440cd6d9 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1315 microversion: 2.1 time: 1.069330 Jun 16 00:27:34.539701 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 28/61] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:33 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1315 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:34.548231 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-34de603c-9115-41f3-9cc9-62f51a63ef6b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:34.550003 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-34de603c-9115-41f3-9cc9-62f51a63ef6b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:34.559375 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-34de603c-9115-41f3-9cc9-62f51a63ef6b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:34.560463 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-34de603c-9115-41f3-9cc9-62f51a63ef6b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:34.561538 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-34de603c-9115-41f3-9cc9-62f51a63ef6b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:34.562585 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-34de603c-9115-41f3-9cc9-62f51a63ef6b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:34.568764 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-ebae3bbf-5cf1-4b10-bcdd-1bcd00690374 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:34.578634 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-ebae3bbf-5cf1-4b10-bcdd-1bcd00690374 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1280 microversion: 2.1 time: 0.417220 Jun 16 00:27:34.590314 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 34/62] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:34 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1280 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:34.766039 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-34de603c-9115-41f3-9cc9-62f51a63ef6b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:34.779436 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-34de603c-9115-41f3-9cc9-62f51a63ef6b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:34.781223 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-34de603c-9115-41f3-9cc9-62f51a63ef6b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:34.786224 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-34de603c-9115-41f3-9cc9-62f51a63ef6b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1406 microversion: 2.20 time: 0.245298 Jun 16 00:27:34.787176 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 29/63] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:34 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:35.546457 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b9eb4448-67d9-4df5-8df2-5a8ddf5f1c2d tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:35.551620 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-b9eb4448-67d9-4df5-8df2-5a8ddf5f1c2d tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:35.558214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b9eb4448-67d9-4df5-8df2-5a8ddf5f1c2d tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:35.558915 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b9eb4448-67d9-4df5-8df2-5a8ddf5f1c2d tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:35.559887 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b9eb4448-67d9-4df5-8df2-5a8ddf5f1c2d tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:35.560521 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b9eb4448-67d9-4df5-8df2-5a8ddf5f1c2d tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:35.595328 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-5b5c924e-ac85-4d74-b76e-ad6f592290cd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:35.596628 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-5b5c924e-ac85-4d74-b76e-ad6f592290cd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:35.609654 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5b5c924e-ac85-4d74-b76e-ad6f592290cd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:35.610582 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5b5c924e-ac85-4d74-b76e-ad6f592290cd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:35.611590 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5b5c924e-ac85-4d74-b76e-ad6f592290cd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:35.612097 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5b5c924e-ac85-4d74-b76e-ad6f592290cd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:35.765391 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b9eb4448-67d9-4df5-8df2-5a8ddf5f1c2d tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:35.775193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-b9eb4448-67d9-4df5-8df2-5a8ddf5f1c2d tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1315 microversion: 2.1 time: 0.232445 Jun 16 00:27:35.786670 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 35/64] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:35 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:35.806034 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-751b44ca-9549-4b10-a47f-0f774a0e8e1d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:35.807300 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-751b44ca-9549-4b10-a47f-0f774a0e8e1d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:35.817398 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-751b44ca-9549-4b10-a47f-0f774a0e8e1d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:35.817858 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-751b44ca-9549-4b10-a47f-0f774a0e8e1d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:35.818798 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-751b44ca-9549-4b10-a47f-0f774a0e8e1d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:35.821374 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-751b44ca-9549-4b10-a47f-0f774a0e8e1d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:35.835702 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-5b5c924e-ac85-4d74-b76e-ad6f592290cd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:35.847338 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-5b5c924e-ac85-4d74-b76e-ad6f592290cd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.255602 Jun 16 00:27:35.849972 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 30/65] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:35 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:36.017340 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-751b44ca-9549-4b10-a47f-0f774a0e8e1d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:36.028188 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-751b44ca-9549-4b10-a47f-0f774a0e8e1d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:36.029793 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-751b44ca-9549-4b10-a47f-0f774a0e8e1d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:36.030911 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-751b44ca-9549-4b10-a47f-0f774a0e8e1d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1406 microversion: 2.20 time: 0.229501 Jun 16 00:27:36.031670 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 36/66] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:35 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:27:36.794466 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-f2b8a6eb-e604-4a17-9929-d9517887df47 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:36.795748 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-f2b8a6eb-e604-4a17-9929-d9517887df47 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:36.801788 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f2b8a6eb-e604-4a17-9929-d9517887df47 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:36.802444 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f2b8a6eb-e604-4a17-9929-d9517887df47 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:36.803550 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f2b8a6eb-e604-4a17-9929-d9517887df47 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:36.804242 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f2b8a6eb-e604-4a17-9929-d9517887df47 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:36.870638 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-bff04f76-5e03-413e-aed8-50abd4da89b4 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:36.872861 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-bff04f76-5e03-413e-aed8-50abd4da89b4 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:36.885444 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bff04f76-5e03-413e-aed8-50abd4da89b4 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:36.886287 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bff04f76-5e03-413e-aed8-50abd4da89b4 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:36.887835 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bff04f76-5e03-413e-aed8-50abd4da89b4 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:36.888724 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bff04f76-5e03-413e-aed8-50abd4da89b4 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:37.083311 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-f2b8a6eb-e604-4a17-9929-d9517887df47 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:37.099308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-f2b8a6eb-e604-4a17-9929-d9517887df47 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1315 microversion: 2.1 time: 0.306910 Jun 16 00:27:37.105485 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 31/67] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:36 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:37.114823 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-743121a4-e360-4ca3-a3c4-cf3daebbb489 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:37.115613 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-743121a4-e360-4ca3-a3c4-cf3daebbb489 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:37.123431 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-743121a4-e360-4ca3-a3c4-cf3daebbb489 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:37.124441 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-743121a4-e360-4ca3-a3c4-cf3daebbb489 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:37.125910 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-743121a4-e360-4ca3-a3c4-cf3daebbb489 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:37.126679 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-743121a4-e360-4ca3-a3c4-cf3daebbb489 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:37.233522 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-bff04f76-5e03-413e-aed8-50abd4da89b4 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:37.242000 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-bff04f76-5e03-413e-aed8-50abd4da89b4 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.377734 Jun 16 00:27:37.243406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 37/68] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:36 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:37.309927 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-743121a4-e360-4ca3-a3c4-cf3daebbb489 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:37.321983 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-743121a4-e360-4ca3-a3c4-cf3daebbb489 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:37.323478 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-743121a4-e360-4ca3-a3c4-cf3daebbb489 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:37.333191 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-743121a4-e360-4ca3-a3c4-cf3daebbb489 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1406 microversion: 2.20 time: 0.226079 Jun 16 00:27:37.333832 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 32/69] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:37 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:38.119869 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8644f794-c120-4d1e-a3cf-0da36bb3b532 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:38.121573 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-8644f794-c120-4d1e-a3cf-0da36bb3b532 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:38.137459 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8644f794-c120-4d1e-a3cf-0da36bb3b532 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:38.138388 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8644f794-c120-4d1e-a3cf-0da36bb3b532 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:38.139709 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8644f794-c120-4d1e-a3cf-0da36bb3b532 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:38.140576 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8644f794-c120-4d1e-a3cf-0da36bb3b532 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:38.176683 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=22 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:38.261272 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-3c02e902-7b68-4c12-8f2c-a97af2a93fc5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:38.262773 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-3c02e902-7b68-4c12-8f2c-a97af2a93fc5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:38.276022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3c02e902-7b68-4c12-8f2c-a97af2a93fc5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:38.276829 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3c02e902-7b68-4c12-8f2c-a97af2a93fc5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:38.279768 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3c02e902-7b68-4c12-8f2c-a97af2a93fc5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:38.280420 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3c02e902-7b68-4c12-8f2c-a97af2a93fc5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:38.403172 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=2 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:38.513493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-8644f794-c120-4d1e-a3cf-0da36bb3b532 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:38.529622 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-8644f794-c120-4d1e-a3cf-0da36bb3b532 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1315 microversion: 2.1 time: 0.414887 Jun 16 00:27:38.530885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 38/70] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:38 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:38.559415 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-f4b2f899-81e4-4065-86d3-b63b2c8ccc1e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:38.560552 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-f4b2f899-81e4-4065-86d3-b63b2c8ccc1e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:38.578338 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-3c02e902-7b68-4c12-8f2c-a97af2a93fc5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:38.585164 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f4b2f899-81e4-4065-86d3-b63b2c8ccc1e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:38.586799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f4b2f899-81e4-4065-86d3-b63b2c8ccc1e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:38.588310 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-3c02e902-7b68-4c12-8f2c-a97af2a93fc5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.332492 Jun 16 00:27:38.589165 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 33/71] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:38 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:38.605404 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f4b2f899-81e4-4065-86d3-b63b2c8ccc1e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:38.606287 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f4b2f899-81e4-4065-86d3-b63b2c8ccc1e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:38.888152 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f4b2f899-81e4-4065-86d3-b63b2c8ccc1e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:38.905976 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f4b2f899-81e4-4065-86d3-b63b2c8ccc1e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:38.913492 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f4b2f899-81e4-4065-86d3-b63b2c8ccc1e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:38.915546 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-f4b2f899-81e4-4065-86d3-b63b2c8ccc1e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1406 microversion: 2.20 time: 0.366516 Jun 16 00:27:38.916923 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 39/72] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:38 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1406 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:39.554908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-936904a2-5d50-4705-b0be-f944b840e3a7 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:39.555656 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-936904a2-5d50-4705-b0be-f944b840e3a7 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:39.557685 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=16 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:39.564556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-936904a2-5d50-4705-b0be-f944b840e3a7 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:39.565043 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-936904a2-5d50-4705-b0be-f944b840e3a7 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:39.565809 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-936904a2-5d50-4705-b0be-f944b840e3a7 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:39.566245 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-936904a2-5d50-4705-b0be-f944b840e3a7 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:39.609375 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-aae32380-5831-428a-9d40-b7ce7e1c40f2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:39.609375 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-aae32380-5831-428a-9d40-b7ce7e1c40f2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:39.616303 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-aae32380-5831-428a-9d40-b7ce7e1c40f2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:39.616817 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-aae32380-5831-428a-9d40-b7ce7e1c40f2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:39.618586 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-aae32380-5831-428a-9d40-b7ce7e1c40f2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:39.619118 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-aae32380-5831-428a-9d40-b7ce7e1c40f2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:39.764478 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-936904a2-5d50-4705-b0be-f944b840e3a7 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:39.774922 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-936904a2-5d50-4705-b0be-f944b840e3a7 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1315 microversion: 2.1 time: 0.223979 Jun 16 00:27:39.776192 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 34/73] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:39 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:39.796246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-aae32380-5831-428a-9d40-b7ce7e1c40f2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:39.804155 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-aae32380-5831-428a-9d40-b7ce7e1c40f2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.199377 Jun 16 00:27:39.805373 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 40/74] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:39 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:39.934633 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-ffd96b33-59fd-4054-854e-5d3c83e78b44 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:39.935654 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-ffd96b33-59fd-4054-854e-5d3c83e78b44 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:39.941938 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ffd96b33-59fd-4054-854e-5d3c83e78b44 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:39.942387 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ffd96b33-59fd-4054-854e-5d3c83e78b44 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:39.943210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ffd96b33-59fd-4054-854e-5d3c83e78b44 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:39.948059 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ffd96b33-59fd-4054-854e-5d3c83e78b44 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:40.083628 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-ffd96b33-59fd-4054-854e-5d3c83e78b44 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:40.093392 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-ffd96b33-59fd-4054-854e-5d3c83e78b44 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:40.095193 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-ffd96b33-59fd-4054-854e-5d3c83e78b44 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:40.096941 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-ffd96b33-59fd-4054-854e-5d3c83e78b44 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1406 microversion: 2.20 time: 0.166942 Jun 16 00:27:40.097713 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 35/75] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:39 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:40.799146 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-2e37a3e8-3138-4ee5-940f-9742837f6327 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:40.799901 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-2e37a3e8-3138-4ee5-940f-9742837f6327 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:40.812137 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2e37a3e8-3138-4ee5-940f-9742837f6327 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:40.813550 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2e37a3e8-3138-4ee5-940f-9742837f6327 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:40.814717 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2e37a3e8-3138-4ee5-940f-9742837f6327 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:40.815848 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2e37a3e8-3138-4ee5-940f-9742837f6327 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:40.830539 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-a9d1329e-51fe-418a-9f1e-cc7eb35a0a00 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:40.834049 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-a9d1329e-51fe-418a-9f1e-cc7eb35a0a00 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:40.835964 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=4 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:40.858957 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a9d1329e-51fe-418a-9f1e-cc7eb35a0a00 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:40.859615 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a9d1329e-51fe-418a-9f1e-cc7eb35a0a00 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:40.864818 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a9d1329e-51fe-418a-9f1e-cc7eb35a0a00 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:40.865348 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a9d1329e-51fe-418a-9f1e-cc7eb35a0a00 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:40.875554 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=100 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:41.246981 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-a9d1329e-51fe-418a-9f1e-cc7eb35a0a00 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:41.255717 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-a9d1329e-51fe-418a-9f1e-cc7eb35a0a00 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.437444 Jun 16 00:27:41.256294 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 36/76] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:40 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:41.276669 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-560996cd-f755-4cb5-abfb-7770a4b035d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:41.277642 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-560996cd-f755-4cb5-abfb-7770a4b035d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:41.286107 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-2e37a3e8-3138-4ee5-940f-9742837f6327 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:41.298037 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-2e37a3e8-3138-4ee5-940f-9742837f6327 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1315 microversion: 2.1 time: 0.503403 Jun 16 00:27:41.310201 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 41/77] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:40 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1315 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:41.316324 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-560996cd-f755-4cb5-abfb-7770a4b035d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:41.316825 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-560996cd-f755-4cb5-abfb-7770a4b035d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:41.319303 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-560996cd-f755-4cb5-abfb-7770a4b035d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:41.319749 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-560996cd-f755-4cb5-abfb-7770a4b035d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:41.935194 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-9f525644-2ab3-4c4f-88fb-ffcaba9a24fd req-e2903621-f8e2-4bd7-b94f-4b8df5002aae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d562dae7-709f-477a-b0bf-4aba72960541", "tag": "fb317629-405c-4d69-af57-ef85adb84e2b"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:41.943812 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:41.958001 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-9f525644-2ab3-4c4f-88fb-ffcaba9a24fd req-e2903621-f8e2-4bd7-b94f-4b8df5002aae service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:41.958484 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-9f525644-2ab3-4c4f-88fb-ffcaba9a24fd req-e2903621-f8e2-4bd7-b94f-4b8df5002aae service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:41.979023 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-9f525644-2ab3-4c4f-88fb-ffcaba9a24fd req-e2903621-f8e2-4bd7-b94f-4b8df5002aae service nova] Creating event network-changed:fb317629-405c-4d69-af57-ef85adb84e2b for instance d562dae7-709f-477a-b0bf-4aba72960541 on hv-cinder-84599 Jun 16 00:27:42.000187 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-9f525644-2ab3-4c4f-88fb-ffcaba9a24fd req-e2903621-f8e2-4bd7-b94f-4b8df5002aae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071112 Jun 16 00:27:42.002207 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 42/78] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:27:42.021689 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-bb482fe4-adbe-4157-93d6-33244e7b2332 req-7e599ab9-1b37-45fa-b7a1-9d03dd1df421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b227643-24e7-44b6-acf7-d3801014a8c7", "tag": "c88ef649-3637-4f5d-955c-f88ebc0bb6c5"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:42.039868 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-bb482fe4-adbe-4157-93d6-33244e7b2332 req-7e599ab9-1b37-45fa-b7a1-9d03dd1df421 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:42.041677 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-bb482fe4-adbe-4157-93d6-33244e7b2332 req-7e599ab9-1b37-45fa-b7a1-9d03dd1df421 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:42.053737 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-560996cd-f755-4cb5-abfb-7770a4b035d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:42.066973 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-bb482fe4-adbe-4157-93d6-33244e7b2332 req-7e599ab9-1b37-45fa-b7a1-9d03dd1df421 service nova] Creating event network-changed:c88ef649-3637-4f5d-955c-f88ebc0bb6c5 for instance 6b227643-24e7-44b6-acf7-d3801014a8c7 on hv-cinder-84599 Jun 16 00:27:42.074746 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-bb482fe4-adbe-4157-93d6-33244e7b2332 req-7e599ab9-1b37-45fa-b7a1-9d03dd1df421 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057346 Jun 16 00:27:42.083127 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-560996cd-f755-4cb5-abfb-7770a4b035d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:42.084806 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-560996cd-f755-4cb5-abfb-7770a4b035d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:42.084986 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 43/79] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:27:42.096953 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-560996cd-f755-4cb5-abfb-7770a4b035d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1406 microversion: 2.20 time: 0.839591 Jun 16 00:27:42.098484 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 37/80] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:41 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1406 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:42.277020 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d8c04e64-2a76-4b6b-9fda-f7c591ac96af tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:42.289309 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d8c04e64-2a76-4b6b-9fda-f7c591ac96af tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:42.297188 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=8 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:42.307174 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d8c04e64-2a76-4b6b-9fda-f7c591ac96af tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:42.308141 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d8c04e64-2a76-4b6b-9fda-f7c591ac96af tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:42.309644 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d8c04e64-2a76-4b6b-9fda-f7c591ac96af tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:42.313526 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d8c04e64-2a76-4b6b-9fda-f7c591ac96af tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:42.317285 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-97aa4426-8993-43f3-857a-d47eb48afcd9 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:42.317898 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-97aa4426-8993-43f3-857a-d47eb48afcd9 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:42.347406 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-97aa4426-8993-43f3-857a-d47eb48afcd9 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:42.347962 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-97aa4426-8993-43f3-857a-d47eb48afcd9 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:42.349311 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-97aa4426-8993-43f3-857a-d47eb48afcd9 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:42.350408 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-97aa4426-8993-43f3-857a-d47eb48afcd9 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:42.685247 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-97aa4426-8993-43f3-857a-d47eb48afcd9 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:42.694394 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-97aa4426-8993-43f3-857a-d47eb48afcd9 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1315 microversion: 2.1 time: 0.381478 Jun 16 00:27:42.694978 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 38/81] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:42 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:42.873368 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d8c04e64-2a76-4b6b-9fda-f7c591ac96af tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:42.892307 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d8c04e64-2a76-4b6b-9fda-f7c591ac96af tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.619929 Jun 16 00:27:42.894597 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 44/82] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:42 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:43.116074 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b69f8bf2-b110-4546-8d42-0a7d0ed31385 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:43.116785 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-b69f8bf2-b110-4546-8d42-0a7d0ed31385 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:43.124108 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b69f8bf2-b110-4546-8d42-0a7d0ed31385 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:43.131426 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b69f8bf2-b110-4546-8d42-0a7d0ed31385 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:43.136522 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b69f8bf2-b110-4546-8d42-0a7d0ed31385 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:43.137256 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b69f8bf2-b110-4546-8d42-0a7d0ed31385 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:43.729541 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-7570bff6-cd57-45da-9f09-34d2402231a1 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:43.731752 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-7570bff6-cd57-45da-9f09-34d2402231a1 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:43.740750 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7570bff6-cd57-45da-9f09-34d2402231a1 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:43.741622 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7570bff6-cd57-45da-9f09-34d2402231a1 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:43.743470 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7570bff6-cd57-45da-9f09-34d2402231a1 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:43.744164 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7570bff6-cd57-45da-9f09-34d2402231a1 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:43.955836 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-b69f8bf2-b110-4546-8d42-0a7d0ed31385 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:43.970270 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-b69f8bf2-b110-4546-8d42-0a7d0ed31385 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:43.978070 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-b69f8bf2-b110-4546-8d42-0a7d0ed31385 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:43.982148 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-b69f8bf2-b110-4546-8d42-0a7d0ed31385 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1406 microversion: 2.20 time: 0.870053 Jun 16 00:27:43.996106 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 39/83] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:43 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1406 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:44.001917 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-59448493-60a3-486a-8e84-4d43427ff533 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:44.002544 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-59448493-60a3-486a-8e84-4d43427ff533 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:44.019978 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59448493-60a3-486a-8e84-4d43427ff533 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:44.024322 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59448493-60a3-486a-8e84-4d43427ff533 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:44.026023 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59448493-60a3-486a-8e84-4d43427ff533 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:44.026797 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59448493-60a3-486a-8e84-4d43427ff533 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:44.292735 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-7570bff6-cd57-45da-9f09-34d2402231a1 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:44.309597 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-7570bff6-cd57-45da-9f09-34d2402231a1 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1315 microversion: 2.1 time: 0.591897 Jun 16 00:27:44.310300 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 45/84] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:43 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:44.459194 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-59448493-60a3-486a-8e84-4d43427ff533 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:44.481286 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-59448493-60a3-486a-8e84-4d43427ff533 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.487104 Jun 16 00:27:44.483195 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 40/85] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:43 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:45.006913 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-f38c7333-2a17-4893-886c-5e997454961f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:45.007548 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-f38c7333-2a17-4893-886c-5e997454961f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:45.025455 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f38c7333-2a17-4893-886c-5e997454961f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:45.027696 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f38c7333-2a17-4893-886c-5e997454961f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:45.031083 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f38c7333-2a17-4893-886c-5e997454961f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:45.033316 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f38c7333-2a17-4893-886c-5e997454961f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:45.327602 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-4af1f1a8-08c0-4a09-a514-cb7ccfe4d026 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:45.328547 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-4af1f1a8-08c0-4a09-a514-cb7ccfe4d026 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:45.346217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4af1f1a8-08c0-4a09-a514-cb7ccfe4d026 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:45.348124 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4af1f1a8-08c0-4a09-a514-cb7ccfe4d026 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:45.350044 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4af1f1a8-08c0-4a09-a514-cb7ccfe4d026 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:45.351818 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4af1f1a8-08c0-4a09-a514-cb7ccfe4d026 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:45.362788 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=100 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:45.446571 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f38c7333-2a17-4893-886c-5e997454961f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:45.462739 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f38c7333-2a17-4893-886c-5e997454961f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:45.464860 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f38c7333-2a17-4893-886c-5e997454961f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:45.466251 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-f38c7333-2a17-4893-886c-5e997454961f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1406 microversion: 2.20 time: 0.466140 Jun 16 00:27:45.466968 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 46/86] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:44 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1406 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:45.499894 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-3054fac4-2a05-4127-8f39-5b8236bf0873 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:45.500503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-3054fac4-2a05-4127-8f39-5b8236bf0873 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:45.514306 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3054fac4-2a05-4127-8f39-5b8236bf0873 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:45.514763 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3054fac4-2a05-4127-8f39-5b8236bf0873 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:45.515530 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3054fac4-2a05-4127-8f39-5b8236bf0873 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:45.516625 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3054fac4-2a05-4127-8f39-5b8236bf0873 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:45.674350 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-4af1f1a8-08c0-4a09-a514-cb7ccfe4d026 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:45.699911 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-4af1f1a8-08c0-4a09-a514-cb7ccfe4d026 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1315 microversion: 2.1 time: 0.375183 Jun 16 00:27:45.701643 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 41/87] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:45 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:45.816504 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-3054fac4-2a05-4127-8f39-5b8236bf0873 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:45.827480 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-3054fac4-2a05-4127-8f39-5b8236bf0873 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.332019 Jun 16 00:27:45.838513 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 47/88] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:45 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:46.481333 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-76e8889d-d1e8-45fc-8d3a-40b0586333f4 req-dc0c418e-5c3e-4923-aed2-a9fffda04d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d3e518-8904-49a1-82d2-c59a7ab09acf", "name": "network-vif-plugged", "status": "completed", "tag": "0f60693e-4470-4a5b-b3e8-6439aa2de3f0"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:46.485387 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-96adc8e5-55c5-4724-bf42-991564f83b9a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:46.486146 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-96adc8e5-55c5-4724-bf42-991564f83b9a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:46.495758 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-96adc8e5-55c5-4724-bf42-991564f83b9a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:46.497718 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-76e8889d-d1e8-45fc-8d3a-40b0586333f4 req-dc0c418e-5c3e-4923-aed2-a9fffda04d21 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:46.498432 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-76e8889d-d1e8-45fc-8d3a-40b0586333f4 req-dc0c418e-5c3e-4923-aed2-a9fffda04d21 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:46.498541 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-96adc8e5-55c5-4724-bf42-991564f83b9a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:46.499809 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-96adc8e5-55c5-4724-bf42-991564f83b9a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:46.500240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-96adc8e5-55c5-4724-bf42-991564f83b9a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:46.528792 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-76e8889d-d1e8-45fc-8d3a-40b0586333f4 req-dc0c418e-5c3e-4923-aed2-a9fffda04d21 service nova] Creating event network-vif-plugged:0f60693e-4470-4a5b-b3e8-6439aa2de3f0 for instance a3d3e518-8904-49a1-82d2-c59a7ab09acf on hv-cinder-84599 Jun 16 00:27:46.529555 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-76e8889d-d1e8-45fc-8d3a-40b0586333f4 req-dc0c418e-5c3e-4923-aed2-a9fffda04d21 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124231) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 00:27:46.534140 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ced77c58-6a6b-4652-a981-4826e249a537 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:46.537779 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ced77c58-6a6b-4652-a981-4826e249a537 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:46.542837 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ced77c58-6a6b-4652-a981-4826e249a537 None None] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:46.545915 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ced77c58-6a6b-4652-a981-4826e249a537 None None] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:46.567238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.compute.rpcapi [None req-ced77c58-6a6b-4652-a981-4826e249a537 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 00:27:46.568932 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ced77c58-6a6b-4652-a981-4826e249a537 None None] Releasing lock "compute-rpcapi-router" {{(pid=124231) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 00:27:46.606455 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-ced77c58-6a6b-4652-a981-4826e249a537 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.708051 Jun 16 00:27:46.609200 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 42/89] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:46.720721 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-75f7da84-f982-4d18-87ca-ba4878aa34bf tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:46.722112 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-75f7da84-f982-4d18-87ca-ba4878aa34bf tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:46.730764 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-75f7da84-f982-4d18-87ca-ba4878aa34bf tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:46.731215 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-75f7da84-f982-4d18-87ca-ba4878aa34bf tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:46.731988 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-75f7da84-f982-4d18-87ca-ba4878aa34bf tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:46.732420 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-75f7da84-f982-4d18-87ca-ba4878aa34bf tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:46.789979 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-96adc8e5-55c5-4724-bf42-991564f83b9a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:46.802916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-96adc8e5-55c5-4724-bf42-991564f83b9a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:46.804917 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-96adc8e5-55c5-4724-bf42-991564f83b9a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:46.805802 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-96adc8e5-55c5-4724-bf42-991564f83b9a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1406 microversion: 2.20 time: 0.324373 Jun 16 00:27:46.816033 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 48/90] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:46 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1406 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:27:46.845771 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-068f703a-52dd-4ae0-b781-3f2a4b25d4e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:46.846414 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-068f703a-52dd-4ae0-b781-3f2a4b25d4e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:46.860011 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-068f703a-52dd-4ae0-b781-3f2a4b25d4e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:46.860608 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-068f703a-52dd-4ae0-b781-3f2a4b25d4e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:46.861522 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-068f703a-52dd-4ae0-b781-3f2a4b25d4e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:46.862196 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-068f703a-52dd-4ae0-b781-3f2a4b25d4e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:47.012865 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-75f7da84-f982-4d18-87ca-ba4878aa34bf tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:47.021711 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-75f7da84-f982-4d18-87ca-ba4878aa34bf tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1315 microversion: 2.1 time: 0.306214 Jun 16 00:27:47.022226 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 43/91] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:46 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:47.113973 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-068f703a-52dd-4ae0-b781-3f2a4b25d4e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:47.130037 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-068f703a-52dd-4ae0-b781-3f2a4b25d4e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.288599 Jun 16 00:27:47.137502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 49/92] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:46 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:47.827289 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-a0b335f5-cb60-495b-b967-02e5e480c6a4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:47.829423 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-a0b335f5-cb60-495b-b967-02e5e480c6a4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:47.835991 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a0b335f5-cb60-495b-b967-02e5e480c6a4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:47.836780 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a0b335f5-cb60-495b-b967-02e5e480c6a4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:47.838004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a0b335f5-cb60-495b-b967-02e5e480c6a4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:47.838718 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a0b335f5-cb60-495b-b967-02e5e480c6a4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:48.037143 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-a0b335f5-cb60-495b-b967-02e5e480c6a4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:48.040747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c9c86bad-7ed5-445a-9db4-4e730b39d409 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:48.041475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c9c86bad-7ed5-445a-9db4-4e730b39d409 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:48.052085 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-a0b335f5-cb60-495b-b967-02e5e480c6a4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:48.055244 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-a0b335f5-cb60-495b-b967-02e5e480c6a4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:48.056027 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c9c86bad-7ed5-445a-9db4-4e730b39d409 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:48.056497 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c9c86bad-7ed5-445a-9db4-4e730b39d409 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:48.057303 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c9c86bad-7ed5-445a-9db4-4e730b39d409 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:48.057534 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-a0b335f5-cb60-495b-b967-02e5e480c6a4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1406 microversion: 2.20 time: 0.238692 Jun 16 00:27:48.057731 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c9c86bad-7ed5-445a-9db4-4e730b39d409 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:48.065533 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 44/93] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:47 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:48.149143 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-e711af20-ffb8-4723-8777-173d9f5a3952 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:48.150071 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-e711af20-ffb8-4723-8777-173d9f5a3952 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:48.159104 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e711af20-ffb8-4723-8777-173d9f5a3952 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:48.159747 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e711af20-ffb8-4723-8777-173d9f5a3952 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:48.160758 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e711af20-ffb8-4723-8777-173d9f5a3952 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:48.161439 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e711af20-ffb8-4723-8777-173d9f5a3952 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:48.234859 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c9c86bad-7ed5-445a-9db4-4e730b39d409 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:48.259417 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c9c86bad-7ed5-445a-9db4-4e730b39d409 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1315 microversion: 2.1 time: 0.223777 Jun 16 00:27:48.261047 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 50/94] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:48 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:48.327032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-e711af20-ffb8-4723-8777-173d9f5a3952 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:48.337675 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-e711af20-ffb8-4723-8777-173d9f5a3952 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.193427 Jun 16 00:27:48.338541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 45/95] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:48 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:48.633708 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-066b23b3-629f-4604-a623-4c30af4d2636 req-4222fcf7-4289-43f7-8dd7-55f8371338c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0", "name": "network-vif-plugged", "status": "completed", "tag": "706dd94f-c3cb-40fa-a55b-a032e4c5f87b"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:48.641721 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-066b23b3-629f-4604-a623-4c30af4d2636 req-4222fcf7-4289-43f7-8dd7-55f8371338c9 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:48.642154 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-066b23b3-629f-4604-a623-4c30af4d2636 req-4222fcf7-4289-43f7-8dd7-55f8371338c9 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:48.659872 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-066b23b3-629f-4604-a623-4c30af4d2636 req-4222fcf7-4289-43f7-8dd7-55f8371338c9 service nova] Creating event network-vif-plugged:706dd94f-c3cb-40fa-a55b-a032e4c5f87b for instance c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 on hv-cinder-84599 Jun 16 00:27:48.665639 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-066b23b3-629f-4604-a623-4c30af4d2636 req-4222fcf7-4289-43f7-8dd7-55f8371338c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036031 Jun 16 00:27:48.666548 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 51/96] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:49.076426 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-07964517-06d8-4605-9f24-93ff1761d101 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:49.077063 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-07964517-06d8-4605-9f24-93ff1761d101 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:49.084301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-07964517-06d8-4605-9f24-93ff1761d101 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:49.084751 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-07964517-06d8-4605-9f24-93ff1761d101 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:49.085608 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-07964517-06d8-4605-9f24-93ff1761d101 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:49.086658 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-07964517-06d8-4605-9f24-93ff1761d101 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:49.277723 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-39da4099-8a4d-4b6b-90d7-7875aad13f00 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:49.278782 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-39da4099-8a4d-4b6b-90d7-7875aad13f00 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:49.291668 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-39da4099-8a4d-4b6b-90d7-7875aad13f00 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:49.292263 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-39da4099-8a4d-4b6b-90d7-7875aad13f00 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:49.293187 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-39da4099-8a4d-4b6b-90d7-7875aad13f00 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:49.294634 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-39da4099-8a4d-4b6b-90d7-7875aad13f00 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:49.409338 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-07964517-06d8-4605-9f24-93ff1761d101 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:49.423375 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-07964517-06d8-4605-9f24-93ff1761d101 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:49.425788 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-07964517-06d8-4605-9f24-93ff1761d101 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:49.429619 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-07964517-06d8-4605-9f24-93ff1761d101 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1406 microversion: 2.20 time: 0.355739 Jun 16 00:27:49.432763 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 46/97] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:49 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1406 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:49.442630 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-ab9d1104-732e-46e2-ba26-84719bd1b91e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:49.446076 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-ab9d1104-732e-46e2-ba26-84719bd1b91e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:49.462048 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ab9d1104-732e-46e2-ba26-84719bd1b91e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:49.463268 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ab9d1104-732e-46e2-ba26-84719bd1b91e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:49.466257 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ab9d1104-732e-46e2-ba26-84719bd1b91e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:49.466846 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ab9d1104-732e-46e2-ba26-84719bd1b91e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:49.552458 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-39da4099-8a4d-4b6b-90d7-7875aad13f00 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:49.562205 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-39da4099-8a4d-4b6b-90d7-7875aad13f00 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1315 microversion: 2.1 time: 0.289583 Jun 16 00:27:49.563943 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 52/98] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:49 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:49.683161 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-ab9d1104-732e-46e2-ba26-84719bd1b91e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:49.692460 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-ab9d1104-732e-46e2-ba26-84719bd1b91e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.258317 Jun 16 00:27:49.693416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 47/99] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:49 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:50.460421 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-17b1bc91-9a7c-4ae6-a48c-5e1ee2ca1017 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:50.462333 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-17b1bc91-9a7c-4ae6-a48c-5e1ee2ca1017 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:50.498331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-17b1bc91-9a7c-4ae6-a48c-5e1ee2ca1017 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:50.502499 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-17b1bc91-9a7c-4ae6-a48c-5e1ee2ca1017 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:50.503855 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-17b1bc91-9a7c-4ae6-a48c-5e1ee2ca1017 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:50.511711 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-17b1bc91-9a7c-4ae6-a48c-5e1ee2ca1017 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:50.580456 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-61a4add8-4b8a-4dfd-a2bc-bd60a2fef5cd tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:50.581187 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-61a4add8-4b8a-4dfd-a2bc-bd60a2fef5cd tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:50.588303 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-61a4add8-4b8a-4dfd-a2bc-bd60a2fef5cd tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:50.589054 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-61a4add8-4b8a-4dfd-a2bc-bd60a2fef5cd tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:50.590183 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-61a4add8-4b8a-4dfd-a2bc-bd60a2fef5cd tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:50.591433 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-61a4add8-4b8a-4dfd-a2bc-bd60a2fef5cd tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:50.796531 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-17b1bc91-9a7c-4ae6-a48c-5e1ee2ca1017 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:50.811245 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-17b1bc91-9a7c-4ae6-a48c-5e1ee2ca1017 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:50.813824 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-17b1bc91-9a7c-4ae6-a48c-5e1ee2ca1017 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:50.818135 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-61a4add8-4b8a-4dfd-a2bc-bd60a2fef5cd tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:50.819334 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-17b1bc91-9a7c-4ae6-a48c-5e1ee2ca1017 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1406 microversion: 2.20 time: 0.374178 Jun 16 00:27:50.823560 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 53/100] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:50 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1406 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:50.829048 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-61a4add8-4b8a-4dfd-a2bc-bd60a2fef5cd tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1501 microversion: 2.1 time: 0.253525 Jun 16 00:27:50.829799 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 48/101] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:50 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1501 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:50.837230 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-19b260e6-0862-4b0d-bd82-23bad36831d2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:50.838191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-19b260e6-0862-4b0d-bd82-23bad36831d2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:50.845022 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-19b260e6-0862-4b0d-bd82-23bad36831d2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:50.845822 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-19b260e6-0862-4b0d-bd82-23bad36831d2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:50.846690 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-19b260e6-0862-4b0d-bd82-23bad36831d2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:50.847219 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-19b260e6-0862-4b0d-bd82-23bad36831d2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:51.054914 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-19b260e6-0862-4b0d-bd82-23bad36831d2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:51.066314 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-19b260e6-0862-4b0d-bd82-23bad36831d2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.240334 Jun 16 00:27:51.069509 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 54/102] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:50 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:51.432149 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-e8dd93ea-d6f5-4311-857b-4c96558fdc05 req-c2fae735-61cf-4263-92e1-bc8656f07aab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b227643-24e7-44b6-acf7-d3801014a8c7", "name": "network-vif-plugged", "status": "completed", "tag": "c88ef649-3637-4f5d-955c-f88ebc0bb6c5"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:51.446866 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-e8dd93ea-d6f5-4311-857b-4c96558fdc05 req-c2fae735-61cf-4263-92e1-bc8656f07aab service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:51.451009 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-e8dd93ea-d6f5-4311-857b-4c96558fdc05 req-c2fae735-61cf-4263-92e1-bc8656f07aab service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:51.480972 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-e8dd93ea-d6f5-4311-857b-4c96558fdc05 req-c2fae735-61cf-4263-92e1-bc8656f07aab service nova] Creating event network-vif-plugged:c88ef649-3637-4f5d-955c-f88ebc0bb6c5 for instance 6b227643-24e7-44b6-acf7-d3801014a8c7 on hv-cinder-84599 Jun 16 00:27:51.489437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-e8dd93ea-d6f5-4311-857b-4c96558fdc05 req-c2fae735-61cf-4263-92e1-bc8656f07aab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060901 Jun 16 00:27:51.491268 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 49/103] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:27:51.840739 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-84210d60-6cb3-45e1-993a-c7a371523a5f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:51.841390 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-84210d60-6cb3-45e1-993a-c7a371523a5f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:51.863589 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-84210d60-6cb3-45e1-993a-c7a371523a5f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:51.865157 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-84210d60-6cb3-45e1-993a-c7a371523a5f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:51.868750 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-84210d60-6cb3-45e1-993a-c7a371523a5f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:51.869435 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-84210d60-6cb3-45e1-993a-c7a371523a5f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:52.072592 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-84210d60-6cb3-45e1-993a-c7a371523a5f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:52.086016 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-63d29693-7a53-4889-b747-ed9f75f2e3e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:52.086802 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-63d29693-7a53-4889-b747-ed9f75f2e3e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:52.091121 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-84210d60-6cb3-45e1-993a-c7a371523a5f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:52.093789 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-84210d60-6cb3-45e1-993a-c7a371523a5f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:52.095816 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-84210d60-6cb3-45e1-993a-c7a371523a5f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1406 microversion: 2.20 time: 0.259013 Jun 16 00:27:52.097165 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 55/104] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:51 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1406 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:52.103191 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-63d29693-7a53-4889-b747-ed9f75f2e3e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:52.106225 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-63d29693-7a53-4889-b747-ed9f75f2e3e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:52.107190 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-63d29693-7a53-4889-b747-ed9f75f2e3e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:52.109491 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-63d29693-7a53-4889-b747-ed9f75f2e3e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:52.295233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-63d29693-7a53-4889-b747-ed9f75f2e3e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:52.306383 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-63d29693-7a53-4889-b747-ed9f75f2e3e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.224782 Jun 16 00:27:52.307659 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 50/105] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:52 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:52.938150 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-114e4815-d46a-405c-b689-787870f02b92 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9f265b6-486b-474c-a300-dddfb39b6f27"}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:52.939315 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-114e4815-d46a-405c-b689-787870f02b92 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:52.945915 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-114e4815-d46a-405c-b689-787870f02b92 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:52.946357 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-114e4815-d46a-405c-b689-787870f02b92 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:52.947112 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-114e4815-d46a-405c-b689-787870f02b92 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:52.947546 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-114e4815-d46a-405c-b689-787870f02b92 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:53.113955 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-483f81ce-3d03-4913-9f8c-b69b7f99d25a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:53.114550 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-483f81ce-3d03-4913-9f8c-b69b7f99d25a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:53.121571 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-483f81ce-3d03-4913-9f8c-b69b7f99d25a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:53.122048 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-483f81ce-3d03-4913-9f8c-b69b7f99d25a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:53.122877 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-483f81ce-3d03-4913-9f8c-b69b7f99d25a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:53.123314 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-483f81ce-3d03-4913-9f8c-b69b7f99d25a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:53.286438 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-483f81ce-3d03-4913-9f8c-b69b7f99d25a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:53.296114 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-483f81ce-3d03-4913-9f8c-b69b7f99d25a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:53.297771 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-483f81ce-3d03-4913-9f8c-b69b7f99d25a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:53.298876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-483f81ce-3d03-4913-9f8c-b69b7f99d25a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1406 microversion: 2.20 time: 0.188746 Jun 16 00:27:53.299435 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 51/106] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:53 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:27:53.329876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-f2850f42-a6d6-48ad-8c0e-1ac3b993d4d9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:53.330488 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-f2850f42-a6d6-48ad-8c0e-1ac3b993d4d9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:53.350044 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f2850f42-a6d6-48ad-8c0e-1ac3b993d4d9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:53.350514 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f2850f42-a6d6-48ad-8c0e-1ac3b993d4d9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:53.352009 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f2850f42-a6d6-48ad-8c0e-1ac3b993d4d9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:53.352515 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f2850f42-a6d6-48ad-8c0e-1ac3b993d4d9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:53.500633 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-f2850f42-a6d6-48ad-8c0e-1ac3b993d4d9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:53.509421 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-f2850f42-a6d6-48ad-8c0e-1ac3b993d4d9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.183456 Jun 16 00:27:53.510200 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 52/107] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:53 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:53.521697 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-44a93d0c-1df6-4723-9e02-0f12d82eb3af req-9a163172-3d89-4e9d-98cc-575da92717d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d562dae7-709f-477a-b0bf-4aba72960541", "name": "network-vif-plugged", "status": "completed", "tag": "fb317629-405c-4d69-af57-ef85adb84e2b"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:53.529854 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-44a93d0c-1df6-4723-9e02-0f12d82eb3af req-9a163172-3d89-4e9d-98cc-575da92717d3 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:53.530300 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-44a93d0c-1df6-4723-9e02-0f12d82eb3af req-9a163172-3d89-4e9d-98cc-575da92717d3 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:53.541794 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-44a93d0c-1df6-4723-9e02-0f12d82eb3af req-9a163172-3d89-4e9d-98cc-575da92717d3 service nova] Creating event network-vif-plugged:fb317629-405c-4d69-af57-ef85adb84e2b for instance d562dae7-709f-477a-b0bf-4aba72960541 on hv-cinder-84599 Jun 16 00:27:53.546751 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-44a93d0c-1df6-4723-9e02-0f12d82eb3af req-9a163172-3d89-4e9d-98cc-575da92717d3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028438 Jun 16 00:27:53.547438 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 53/108] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:27:54.318458 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-0f40bc07-d089-4b22-a2c1-9eb407ca464d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:54.319158 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-0f40bc07-d089-4b22-a2c1-9eb407ca464d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:54.326556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0f40bc07-d089-4b22-a2c1-9eb407ca464d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:54.326999 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0f40bc07-d089-4b22-a2c1-9eb407ca464d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:54.327769 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0f40bc07-d089-4b22-a2c1-9eb407ca464d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:54.328194 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0f40bc07-d089-4b22-a2c1-9eb407ca464d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:54.469938 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-0f40bc07-d089-4b22-a2c1-9eb407ca464d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:54.478627 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-0f40bc07-d089-4b22-a2c1-9eb407ca464d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:54.480120 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-0f40bc07-d089-4b22-a2c1-9eb407ca464d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:54.481297 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-0f40bc07-d089-4b22-a2c1-9eb407ca464d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1406 microversion: 2.20 time: 0.167243 Jun 16 00:27:54.481847 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 54/109] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:54 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:27:54.528339 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-92600905-643e-4684-8a3d-61acab89cd4c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:54.528980 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-92600905-643e-4684-8a3d-61acab89cd4c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:54.534837 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-92600905-643e-4684-8a3d-61acab89cd4c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:54.535283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-92600905-643e-4684-8a3d-61acab89cd4c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:54.536036 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-92600905-643e-4684-8a3d-61acab89cd4c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:54.536471 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-92600905-643e-4684-8a3d-61acab89cd4c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:54.666993 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-92600905-643e-4684-8a3d-61acab89cd4c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:54.676918 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-92600905-643e-4684-8a3d-61acab89cd4c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.151997 Jun 16 00:27:54.677487 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 55/110] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:54 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:55.481547 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-114e4815-d46a-405c-b689-787870f02b92 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "POST /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.546701 Jun 16 00:27:55.486936 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 56/111] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Jun 16 00:27:52 2022] POST /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf/os-volume_attachments => generated 194 bytes in 2549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:55.499270 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-44ad4f81-9182-4422-a89a-5ecfc9b86cd2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:55.500052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-44ad4f81-9182-4422-a89a-5ecfc9b86cd2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:55.508578 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-44ad4f81-9182-4422-a89a-5ecfc9b86cd2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:55.509170 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-44ad4f81-9182-4422-a89a-5ecfc9b86cd2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:55.510931 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-44ad4f81-9182-4422-a89a-5ecfc9b86cd2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:55.511375 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-44ad4f81-9182-4422-a89a-5ecfc9b86cd2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:55.654103 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-44ad4f81-9182-4422-a89a-5ecfc9b86cd2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:55.663242 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-44ad4f81-9182-4422-a89a-5ecfc9b86cd2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:55.665332 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-44ad4f81-9182-4422-a89a-5ecfc9b86cd2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:55.666437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-44ad4f81-9182-4422-a89a-5ecfc9b86cd2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1406 microversion: 2.20 time: 0.171600 Jun 16 00:27:55.667004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 56/112] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:55 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:55.694098 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-397703fe-f73a-4e0c-aaff-db5bd0467b04 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:55.694872 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-397703fe-f73a-4e0c-aaff-db5bd0467b04 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:55.702086 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-397703fe-f73a-4e0c-aaff-db5bd0467b04 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:55.702529 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-397703fe-f73a-4e0c-aaff-db5bd0467b04 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:55.703281 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-397703fe-f73a-4e0c-aaff-db5bd0467b04 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:55.703711 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-397703fe-f73a-4e0c-aaff-db5bd0467b04 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:55.878480 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-397703fe-f73a-4e0c-aaff-db5bd0467b04 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:55.889557 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-397703fe-f73a-4e0c-aaff-db5bd0467b04 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.199541 Jun 16 00:27:55.890150 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 57/113] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:55 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:56.684256 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-f3c23d12-2b53-478a-a388-16c0d6609558 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:56.684859 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-f3c23d12-2b53-478a-a388-16c0d6609558 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:56.686798 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=2 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:56.692289 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f3c23d12-2b53-478a-a388-16c0d6609558 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:56.692731 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f3c23d12-2b53-478a-a388-16c0d6609558 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:56.693522 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f3c23d12-2b53-478a-a388-16c0d6609558 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:56.693947 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f3c23d12-2b53-478a-a388-16c0d6609558 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:56.820237 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-f3c23d12-2b53-478a-a388-16c0d6609558 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:56.828518 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-f3c23d12-2b53-478a-a388-16c0d6609558 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:56.830041 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-f3c23d12-2b53-478a-a388-16c0d6609558 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:56.831169 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-f3c23d12-2b53-478a-a388-16c0d6609558 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1406 microversion: 2.20 time: 0.150749 Jun 16 00:27:56.831729 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 57/114] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:56 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:56.907353 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5f23c710-65ad-489e-ae2d-87a28cbabcdd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:56.907961 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-5f23c710-65ad-489e-ae2d-87a28cbabcdd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:56.915543 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5f23c710-65ad-489e-ae2d-87a28cbabcdd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:56.915987 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5f23c710-65ad-489e-ae2d-87a28cbabcdd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:56.916738 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5f23c710-65ad-489e-ae2d-87a28cbabcdd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:56.917205 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5f23c710-65ad-489e-ae2d-87a28cbabcdd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:57.041584 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-5f23c710-65ad-489e-ae2d-87a28cbabcdd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:57.045302 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:57.052489 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-5f23c710-65ad-489e-ae2d-87a28cbabcdd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.148932 Jun 16 00:27:57.053110 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 58/115] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:56 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:57.849336 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-59acc657-a4e9-4a90-8f0a-9061a1f7c76b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:57.849942 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-59acc657-a4e9-4a90-8f0a-9061a1f7c76b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:57.855949 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59acc657-a4e9-4a90-8f0a-9061a1f7c76b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:57.856392 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59acc657-a4e9-4a90-8f0a-9061a1f7c76b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:57.857177 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59acc657-a4e9-4a90-8f0a-9061a1f7c76b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:57.857609 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59acc657-a4e9-4a90-8f0a-9061a1f7c76b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:57.989050 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-59acc657-a4e9-4a90-8f0a-9061a1f7c76b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:57.997527 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-59acc657-a4e9-4a90-8f0a-9061a1f7c76b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:57.999005 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-59acc657-a4e9-4a90-8f0a-9061a1f7c76b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:58.000082 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-59acc657-a4e9-4a90-8f0a-9061a1f7c76b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1406 microversion: 2.20 time: 0.154617 Jun 16 00:27:58.000633 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 58/116] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:57 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:58.069597 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-9759a684-af83-440a-8ab8-7a8317081500 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:58.070331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-9759a684-af83-440a-8ab8-7a8317081500 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:58.077514 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9759a684-af83-440a-8ab8-7a8317081500 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:58.077951 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9759a684-af83-440a-8ab8-7a8317081500 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:58.078697 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9759a684-af83-440a-8ab8-7a8317081500 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:58.079120 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9759a684-af83-440a-8ab8-7a8317081500 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:58.216165 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-9759a684-af83-440a-8ab8-7a8317081500 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:58.223735 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-9759a684-af83-440a-8ab8-7a8317081500 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.158401 Jun 16 00:27:58.224301 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 59/117] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:58 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:59.018505 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-04cd2255-062f-4ea9-bfb5-55c65249548f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:59.019037 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-04cd2255-062f-4ea9-bfb5-55c65249548f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:59.025441 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-04cd2255-062f-4ea9-bfb5-55c65249548f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:59.025882 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-04cd2255-062f-4ea9-bfb5-55c65249548f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:59.026621 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-04cd2255-062f-4ea9-bfb5-55c65249548f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:59.027044 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-04cd2255-062f-4ea9-bfb5-55c65249548f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:59.045142 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=100 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:59.160642 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-04cd2255-062f-4ea9-bfb5-55c65249548f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:59.175272 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-04cd2255-062f-4ea9-bfb5-55c65249548f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:59.176784 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-04cd2255-062f-4ea9-bfb5-55c65249548f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:59.178023 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-04cd2255-062f-4ea9-bfb5-55c65249548f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1599 microversion: 2.20 time: 0.163388 Jun 16 00:27:59.178804 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 59/118] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:59 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:59.195972 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-606f0e1b-1a11-4d24-a1b8-32ab738bfc6d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:59.196439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-606f0e1b-1a11-4d24-a1b8-32ab738bfc6d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:59.202811 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-606f0e1b-1a11-4d24-a1b8-32ab738bfc6d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:59.203250 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-606f0e1b-1a11-4d24-a1b8-32ab738bfc6d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:59.203995 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-606f0e1b-1a11-4d24-a1b8-32ab738bfc6d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:59.204428 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-606f0e1b-1a11-4d24-a1b8-32ab738bfc6d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:59.241094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-2e7ad101-7dd9-486f-a21f-b9b00a2384f2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:59.241797 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-2e7ad101-7dd9-486f-a21f-b9b00a2384f2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:59.247725 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2e7ad101-7dd9-486f-a21f-b9b00a2384f2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:59.248167 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2e7ad101-7dd9-486f-a21f-b9b00a2384f2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:59.248936 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2e7ad101-7dd9-486f-a21f-b9b00a2384f2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:59.249361 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2e7ad101-7dd9-486f-a21f-b9b00a2384f2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:59.285835 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-606f0e1b-1a11-4d24-a1b8-32ab738bfc6d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093805 Jun 16 00:27:59.286734 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 60/119] 10.222.0.23 () {60 vars in 1315 bytes} [Thu Jun 16 00:27:59 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:27:59.385517 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-2e7ad101-7dd9-486f-a21f-b9b00a2384f2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:59.393396 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-2e7ad101-7dd9-486f-a21f-b9b00a2384f2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.155890 Jun 16 00:27:59.394167 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 60/120] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:59 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:00.411745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-24c88099-3453-454a-b782-9659121cbc49 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:00.411745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-24c88099-3453-454a-b782-9659121cbc49 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:00.418343 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-24c88099-3453-454a-b782-9659121cbc49 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:00.418785 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-24c88099-3453-454a-b782-9659121cbc49 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:00.419538 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-24c88099-3453-454a-b782-9659121cbc49 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:00.419965 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-24c88099-3453-454a-b782-9659121cbc49 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:00.624423 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-24c88099-3453-454a-b782-9659121cbc49 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:00.631809 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-9e99d8b5-9017-496a-b8e5-a561c374ca76 req-617a6e9b-e17f-438b-919e-1edc8f0058b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b227643-24e7-44b6-acf7-d3801014a8c7", "tag": "c88ef649-3637-4f5d-955c-f88ebc0bb6c5"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:28:00.641070 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-9e99d8b5-9017-496a-b8e5-a561c374ca76 req-617a6e9b-e17f-438b-919e-1edc8f0058b5 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:00.641794 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-9e99d8b5-9017-496a-b8e5-a561c374ca76 req-617a6e9b-e17f-438b-919e-1edc8f0058b5 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:00.642196 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-24c88099-3453-454a-b782-9659121cbc49 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.235270 Jun 16 00:28:00.643133 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 61/121] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:00 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:00.662760 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-9e99d8b5-9017-496a-b8e5-a561c374ca76 req-617a6e9b-e17f-438b-919e-1edc8f0058b5 service nova] Creating event network-changed:c88ef649-3637-4f5d-955c-f88ebc0bb6c5 for instance 6b227643-24e7-44b6-acf7-d3801014a8c7 on hv-cinder-84599 Jun 16 00:28:00.668701 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-9e99d8b5-9017-496a-b8e5-a561c374ca76 req-617a6e9b-e17f-438b-919e-1edc8f0058b5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040558 Jun 16 00:28:00.669414 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 61/122] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:28:01.659337 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-0ddcd11e-579f-4b49-83f9-b9f0144ccfb4 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:01.659931 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-0ddcd11e-579f-4b49-83f9-b9f0144ccfb4 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:01.666469 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0ddcd11e-579f-4b49-83f9-b9f0144ccfb4 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:01.666921 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0ddcd11e-579f-4b49-83f9-b9f0144ccfb4 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:01.667686 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0ddcd11e-579f-4b49-83f9-b9f0144ccfb4 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:01.668121 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0ddcd11e-579f-4b49-83f9-b9f0144ccfb4 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:01.807643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0ddcd11e-579f-4b49-83f9-b9f0144ccfb4 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:01.815017 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-0ddcd11e-579f-4b49-83f9-b9f0144ccfb4 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.159509 Jun 16 00:28:01.815594 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 62/123] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:01 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:02.832235 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b22cda3f-6052-43bb-b072-04d3ee316bfe tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:02.832972 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-b22cda3f-6052-43bb-b072-04d3ee316bfe tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:02.840443 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b22cda3f-6052-43bb-b072-04d3ee316bfe tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:02.840905 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b22cda3f-6052-43bb-b072-04d3ee316bfe tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:02.841655 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b22cda3f-6052-43bb-b072-04d3ee316bfe tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:02.842185 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b22cda3f-6052-43bb-b072-04d3ee316bfe tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:02.974059 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-b22cda3f-6052-43bb-b072-04d3ee316bfe tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:02.981896 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-b22cda3f-6052-43bb-b072-04d3ee316bfe tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.153867 Jun 16 00:28:02.982392 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 62/124] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:02 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:03.998317 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5e25b845-1ac1-4baa-aa17-114d82aa03ef tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:03.998914 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-5e25b845-1ac1-4baa-aa17-114d82aa03ef tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:04.005848 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5e25b845-1ac1-4baa-aa17-114d82aa03ef tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:04.006309 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5e25b845-1ac1-4baa-aa17-114d82aa03ef tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:04.007158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5e25b845-1ac1-4baa-aa17-114d82aa03ef tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:04.007619 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5e25b845-1ac1-4baa-aa17-114d82aa03ef tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:04.135886 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-5e25b845-1ac1-4baa-aa17-114d82aa03ef tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:04.143328 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-5e25b845-1ac1-4baa-aa17-114d82aa03ef tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.148724 Jun 16 00:28:04.143880 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 63/125] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:03 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:05.160127 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-f1b9df41-dd94-42c1-b91e-8dbe0b59bb17 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:05.160715 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-f1b9df41-dd94-42c1-b91e-8dbe0b59bb17 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:05.168177 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f1b9df41-dd94-42c1-b91e-8dbe0b59bb17 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:05.168739 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f1b9df41-dd94-42c1-b91e-8dbe0b59bb17 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:05.169567 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f1b9df41-dd94-42c1-b91e-8dbe0b59bb17 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:05.169997 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f1b9df41-dd94-42c1-b91e-8dbe0b59bb17 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:05.303344 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-f1b9df41-dd94-42c1-b91e-8dbe0b59bb17 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:05.311655 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-f1b9df41-dd94-42c1-b91e-8dbe0b59bb17 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.155338 Jun 16 00:28:05.320482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 63/126] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:05 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:06.328379 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-863784ff-618d-43a4-b668-02aea1f28ad1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:06.329023 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-863784ff-618d-43a4-b668-02aea1f28ad1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:06.335533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-863784ff-618d-43a4-b668-02aea1f28ad1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:06.335980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-863784ff-618d-43a4-b668-02aea1f28ad1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:06.338078 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-863784ff-618d-43a4-b668-02aea1f28ad1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:06.338549 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-863784ff-618d-43a4-b668-02aea1f28ad1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:06.476787 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-863784ff-618d-43a4-b668-02aea1f28ad1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:06.484998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-863784ff-618d-43a4-b668-02aea1f28ad1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.160248 Jun 16 00:28:06.485910 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 64/127] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:06 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:07.502038 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-a37faf91-61fa-45a0-9641-5482ed88f7a5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:07.502676 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-a37faf91-61fa-45a0-9641-5482ed88f7a5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:07.508679 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a37faf91-61fa-45a0-9641-5482ed88f7a5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:07.509147 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a37faf91-61fa-45a0-9641-5482ed88f7a5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:07.509926 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a37faf91-61fa-45a0-9641-5482ed88f7a5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:07.510351 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a37faf91-61fa-45a0-9641-5482ed88f7a5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:07.642513 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-a37faf91-61fa-45a0-9641-5482ed88f7a5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:07.650647 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-a37faf91-61fa-45a0-9641-5482ed88f7a5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1322 microversion: 2.1 time: 0.152459 Jun 16 00:28:07.651200 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 64/128] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:07 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:08.667730 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5a3d3c30-8262-488e-aa94-4c27b2cb342d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:08.668240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-5a3d3c30-8262-488e-aa94-4c27b2cb342d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:08.675119 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5a3d3c30-8262-488e-aa94-4c27b2cb342d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:08.675565 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5a3d3c30-8262-488e-aa94-4c27b2cb342d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:08.676412 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5a3d3c30-8262-488e-aa94-4c27b2cb342d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:08.676926 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5a3d3c30-8262-488e-aa94-4c27b2cb342d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:08.998013 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-5a3d3c30-8262-488e-aa94-4c27b2cb342d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:09.005409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-5a3d3c30-8262-488e-aa94-4c27b2cb342d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1516 microversion: 2.1 time: 0.342207 Jun 16 00:28:09.005959 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 65/129] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:08 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1516 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:09.022682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-8de3ba38-1905-4db9-887d-5da7f89bb742 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:28:09.023640 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-8de3ba38-1905-4db9-887d-5da7f89bb742 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:09.030164 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8de3ba38-1905-4db9-887d-5da7f89bb742 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:09.030612 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8de3ba38-1905-4db9-887d-5da7f89bb742 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:09.031368 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8de3ba38-1905-4db9-887d-5da7f89bb742 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:09.031794 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8de3ba38-1905-4db9-887d-5da7f89bb742 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:09.094704 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.objects.instance [None req-8de3ba38-1905-4db9-887d-5da7f89bb742 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lazy-loading 'flavor' on Instance uuid d562dae7-709f-477a-b0bf-4aba72960541 {{(pid=124231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:28:09.210499 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-8de3ba38-1905-4db9-887d-5da7f89bb742 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "POST /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541/action" status: 200 len: 32 microversion: 2.1 time: 0.192138 Jun 16 00:28:09.211120 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 65/130] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Jun 16 00:28:09 2022] POST /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541/action => generated 32 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 00:28:09.220416 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8a87b93e-f3f9-4245-b5fb-6652c66a4215 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:09.221071 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-8a87b93e-f3f9-4245-b5fb-6652c66a4215 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:09.227142 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8a87b93e-f3f9-4245-b5fb-6652c66a4215 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:09.228029 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8a87b93e-f3f9-4245-b5fb-6652c66a4215 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:09.228787 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8a87b93e-f3f9-4245-b5fb-6652c66a4215 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:09.229247 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8a87b93e-f3f9-4245-b5fb-6652c66a4215 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:09.379576 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-8a87b93e-f3f9-4245-b5fb-6652c66a4215 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:09.388522 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-8a87b93e-f3f9-4245-b5fb-6652c66a4215 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.171744 Jun 16 00:28:09.389163 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 66/131] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:09 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:10.406493 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-ade9756d-135a-4f35-be24-097ed910b852 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:10.407231 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-ade9756d-135a-4f35-be24-097ed910b852 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:10.413625 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ade9756d-135a-4f35-be24-097ed910b852 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:10.414099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ade9756d-135a-4f35-be24-097ed910b852 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:10.415590 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ade9756d-135a-4f35-be24-097ed910b852 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:10.416027 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ade9756d-135a-4f35-be24-097ed910b852 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:10.543648 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-ade9756d-135a-4f35-be24-097ed910b852 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:10.551442 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-ade9756d-135a-4f35-be24-097ed910b852 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.149146 Jun 16 00:28:10.552532 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 66/132] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:10 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:11.568665 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-be849bfa-c577-4478-8c6b-03c38b258e6c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:11.569303 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-be849bfa-c577-4478-8c6b-03c38b258e6c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:11.575855 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-be849bfa-c577-4478-8c6b-03c38b258e6c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:11.576301 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-be849bfa-c577-4478-8c6b-03c38b258e6c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:11.577089 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-be849bfa-c577-4478-8c6b-03c38b258e6c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:11.577523 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-be849bfa-c577-4478-8c6b-03c38b258e6c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:11.711400 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-be849bfa-c577-4478-8c6b-03c38b258e6c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:11.719389 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-be849bfa-c577-4478-8c6b-03c38b258e6c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.154414 Jun 16 00:28:11.720146 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 67/133] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:11 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:12.737965 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-08ae564d-cd61-45ea-a4e0-b2d420bfaeae tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:12.738727 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-08ae564d-cd61-45ea-a4e0-b2d420bfaeae tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:12.741816 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=62 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:12.745854 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-08ae564d-cd61-45ea-a4e0-b2d420bfaeae tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:12.746504 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-08ae564d-cd61-45ea-a4e0-b2d420bfaeae tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:12.747261 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-08ae564d-cd61-45ea-a4e0-b2d420bfaeae tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:12.747856 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-08ae564d-cd61-45ea-a4e0-b2d420bfaeae tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:12.931580 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-08ae564d-cd61-45ea-a4e0-b2d420bfaeae tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:12.939926 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-08ae564d-cd61-45ea-a4e0-b2d420bfaeae tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.206167 Jun 16 00:28:12.952071 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 67/134] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:12 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:13.958775 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-9fe83465-1e1f-43b8-b833-3db5011e3d17 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:13.959432 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-9fe83465-1e1f-43b8-b833-3db5011e3d17 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:13.964311 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=52 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:13.969702 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9fe83465-1e1f-43b8-b833-3db5011e3d17 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:13.970216 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9fe83465-1e1f-43b8-b833-3db5011e3d17 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:13.971008 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9fe83465-1e1f-43b8-b833-3db5011e3d17 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:13.971628 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9fe83465-1e1f-43b8-b833-3db5011e3d17 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:14.174708 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-9fe83465-1e1f-43b8-b833-3db5011e3d17 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:14.188791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-9fe83465-1e1f-43b8-b833-3db5011e3d17 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.234029 Jun 16 00:28:14.189527 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 68/135] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:13 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:15.206865 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-cbe64cdf-3ca7-4878-8bdc-421cfefb237d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:15.207474 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-cbe64cdf-3ca7-4878-8bdc-421cfefb237d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:15.213906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cbe64cdf-3ca7-4878-8bdc-421cfefb237d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:15.214552 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cbe64cdf-3ca7-4878-8bdc-421cfefb237d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:15.215332 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cbe64cdf-3ca7-4878-8bdc-421cfefb237d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:15.215774 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cbe64cdf-3ca7-4878-8bdc-421cfefb237d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:15.350840 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-cbe64cdf-3ca7-4878-8bdc-421cfefb237d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:15.360527 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-cbe64cdf-3ca7-4878-8bdc-421cfefb237d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.157369 Jun 16 00:28:15.365062 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 68/136] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:15 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:16.377913 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b8cfc09a-21a0-48f1-a6d2-9cd35ebcbcd5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:16.378534 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-b8cfc09a-21a0-48f1-a6d2-9cd35ebcbcd5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:16.386352 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b8cfc09a-21a0-48f1-a6d2-9cd35ebcbcd5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:16.386831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b8cfc09a-21a0-48f1-a6d2-9cd35ebcbcd5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:16.387851 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b8cfc09a-21a0-48f1-a6d2-9cd35ebcbcd5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:16.388465 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b8cfc09a-21a0-48f1-a6d2-9cd35ebcbcd5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:16.549736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b8cfc09a-21a0-48f1-a6d2-9cd35ebcbcd5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:16.563825 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-b8cfc09a-21a0-48f1-a6d2-9cd35ebcbcd5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.189662 Jun 16 00:28:16.577868 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 69/137] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:16 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:17.581116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-1364f62b-ee75-4afc-865a-bc03f1529721 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:17.581724 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-1364f62b-ee75-4afc-865a-bc03f1529721 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:17.593160 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1364f62b-ee75-4afc-865a-bc03f1529721 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:17.594400 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1364f62b-ee75-4afc-865a-bc03f1529721 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:17.595879 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1364f62b-ee75-4afc-865a-bc03f1529721 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:17.607429 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1364f62b-ee75-4afc-865a-bc03f1529721 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:17.844010 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-1364f62b-ee75-4afc-865a-bc03f1529721 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:17.852394 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-1364f62b-ee75-4afc-865a-bc03f1529721 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.274763 Jun 16 00:28:17.861772 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 69/138] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:17 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:18.870803 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-204dcf43-b313-4870-bb5a-423c3f7845d2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:18.871623 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-204dcf43-b313-4870-bb5a-423c3f7845d2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:18.879685 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-204dcf43-b313-4870-bb5a-423c3f7845d2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:18.880687 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-204dcf43-b313-4870-bb5a-423c3f7845d2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:18.881487 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-204dcf43-b313-4870-bb5a-423c3f7845d2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:18.881932 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-204dcf43-b313-4870-bb5a-423c3f7845d2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:19.033427 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-204dcf43-b313-4870-bb5a-423c3f7845d2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:19.047416 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-204dcf43-b313-4870-bb5a-423c3f7845d2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.181407 Jun 16 00:28:19.048449 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 70/139] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:18 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:20.066422 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-7325b59f-0167-423a-a4c8-2d42e6bf4d0d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:20.067040 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-7325b59f-0167-423a-a4c8-2d42e6bf4d0d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:20.073141 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7325b59f-0167-423a-a4c8-2d42e6bf4d0d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:20.073582 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7325b59f-0167-423a-a4c8-2d42e6bf4d0d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:20.074334 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7325b59f-0167-423a-a4c8-2d42e6bf4d0d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:20.074756 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7325b59f-0167-423a-a4c8-2d42e6bf4d0d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:20.223730 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-7325b59f-0167-423a-a4c8-2d42e6bf4d0d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:20.232517 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-7325b59f-0167-423a-a4c8-2d42e6bf4d0d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.169872 Jun 16 00:28:20.242989 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 70/140] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:20 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:21.249315 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-f72433c8-0848-43f0-943c-89e5b2fc7b6a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:21.249967 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-f72433c8-0848-43f0-943c-89e5b2fc7b6a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:21.256488 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f72433c8-0848-43f0-943c-89e5b2fc7b6a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:21.256970 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f72433c8-0848-43f0-943c-89e5b2fc7b6a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:21.257826 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f72433c8-0848-43f0-943c-89e5b2fc7b6a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:21.258365 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f72433c8-0848-43f0-943c-89e5b2fc7b6a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:21.394221 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f72433c8-0848-43f0-943c-89e5b2fc7b6a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:21.402092 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-f72433c8-0848-43f0-943c-89e5b2fc7b6a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.156676 Jun 16 00:28:21.402647 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 71/141] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:21 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:22.418327 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-c2b70742-7072-400a-b0db-ea3678c3ac74 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:22.418923 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-c2b70742-7072-400a-b0db-ea3678c3ac74 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:22.424873 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c2b70742-7072-400a-b0db-ea3678c3ac74 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:22.425338 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c2b70742-7072-400a-b0db-ea3678c3ac74 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:22.426078 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c2b70742-7072-400a-b0db-ea3678c3ac74 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:22.426504 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c2b70742-7072-400a-b0db-ea3678c3ac74 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:22.561663 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-c2b70742-7072-400a-b0db-ea3678c3ac74 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:22.569266 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-c2b70742-7072-400a-b0db-ea3678c3ac74 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.154833 Jun 16 00:28:22.569825 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 71/142] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:22 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:23.586721 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5146f6ff-34cb-4af6-8e29-b32e9dab1dbd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:23.587366 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-5146f6ff-34cb-4af6-8e29-b32e9dab1dbd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:23.593406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5146f6ff-34cb-4af6-8e29-b32e9dab1dbd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:23.593860 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5146f6ff-34cb-4af6-8e29-b32e9dab1dbd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:23.594632 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5146f6ff-34cb-4af6-8e29-b32e9dab1dbd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:23.595059 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5146f6ff-34cb-4af6-8e29-b32e9dab1dbd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:23.736083 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-5146f6ff-34cb-4af6-8e29-b32e9dab1dbd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:23.744650 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-5146f6ff-34cb-4af6-8e29-b32e9dab1dbd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.162458 Jun 16 00:28:23.745302 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 72/143] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:23 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:24.194715 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-dc2322b7-07b0-4f90-9de1-01e073f7ef5b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:24.195928 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-dc2322b7-07b0-4f90-9de1-01e073f7ef5b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:24.201887 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-dc2322b7-07b0-4f90-9de1-01e073f7ef5b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:24.202375 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-dc2322b7-07b0-4f90-9de1-01e073f7ef5b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:24.203177 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-dc2322b7-07b0-4f90-9de1-01e073f7ef5b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:24.203642 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-dc2322b7-07b0-4f90-9de1-01e073f7ef5b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:24.228057 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-dc2322b7-07b0-4f90-9de1-01e073f7ef5b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Going to try to terminate instance {{(pid=124231) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:28:24.311499 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-dc2322b7-07b0-4f90-9de1-01e073f7ef5b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 204 len: 0 microversion: 2.1 time: 0.120285 Jun 16 00:28:24.312084 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 72/144] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:28:24 2022] DELETE /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:28:24.320039 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-649a468e-ea00-40c0-ac9a-6f0fd932d92b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:24.320642 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-649a468e-ea00-40c0-ac9a-6f0fd932d92b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:24.327031 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-649a468e-ea00-40c0-ac9a-6f0fd932d92b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:24.327533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-649a468e-ea00-40c0-ac9a-6f0fd932d92b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:24.328311 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-649a468e-ea00-40c0-ac9a-6f0fd932d92b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:24.328757 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-649a468e-ea00-40c0-ac9a-6f0fd932d92b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:24.467170 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-649a468e-ea00-40c0-ac9a-6f0fd932d92b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:24.475113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-649a468e-ea00-40c0-ac9a-6f0fd932d92b tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1553 microversion: 2.1 time: 0.158807 Jun 16 00:28:24.475677 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 73/145] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:24 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:24.763710 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-54c5953e-7c3a-43af-8039-8b0652a841a1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:24.764408 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-54c5953e-7c3a-43af-8039-8b0652a841a1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:24.770485 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-54c5953e-7c3a-43af-8039-8b0652a841a1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:24.770928 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-54c5953e-7c3a-43af-8039-8b0652a841a1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:24.771681 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-54c5953e-7c3a-43af-8039-8b0652a841a1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:24.772365 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-54c5953e-7c3a-43af-8039-8b0652a841a1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:24.777690 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:24.908819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-54c5953e-7c3a-43af-8039-8b0652a841a1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:24.918005 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-54c5953e-7c3a-43af-8039-8b0652a841a1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.158538 Jun 16 00:28:24.918539 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 73/146] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:24 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:25.493078 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-f1a825d6-dba0-4e1d-8d90-f7fa7487d5ca tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:25.493704 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-f1a825d6-dba0-4e1d-8d90-f7fa7487d5ca tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:25.500179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f1a825d6-dba0-4e1d-8d90-f7fa7487d5ca tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:25.500619 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f1a825d6-dba0-4e1d-8d90-f7fa7487d5ca tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:25.501388 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f1a825d6-dba0-4e1d-8d90-f7fa7487d5ca tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:25.501811 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f1a825d6-dba0-4e1d-8d90-f7fa7487d5ca tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:25.631855 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f1a825d6-dba0-4e1d-8d90-f7fa7487d5ca tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:25.640095 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-f1a825d6-dba0-4e1d-8d90-f7fa7487d5ca tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1553 microversion: 2.1 time: 0.151199 Jun 16 00:28:25.640716 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 74/147] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:25 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:25.936433 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-465462d4-1ddf-4831-a910-7c58f1b950b1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:25.937092 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-465462d4-1ddf-4831-a910-7c58f1b950b1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:25.942997 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-465462d4-1ddf-4831-a910-7c58f1b950b1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:25.943441 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-465462d4-1ddf-4831-a910-7c58f1b950b1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:25.944193 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-465462d4-1ddf-4831-a910-7c58f1b950b1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:25.944623 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-465462d4-1ddf-4831-a910-7c58f1b950b1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:26.072441 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-465462d4-1ddf-4831-a910-7c58f1b950b1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:26.079774 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-465462d4-1ddf-4831-a910-7c58f1b950b1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.147225 Jun 16 00:28:26.080336 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 74/148] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:25 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:26.658429 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-9673b458-4a4f-4e83-b30d-56496a17915f tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:26.658960 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-9673b458-4a4f-4e83-b30d-56496a17915f tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:26.665965 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9673b458-4a4f-4e83-b30d-56496a17915f tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:26.666427 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9673b458-4a4f-4e83-b30d-56496a17915f tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:26.667169 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9673b458-4a4f-4e83-b30d-56496a17915f tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:26.667587 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9673b458-4a4f-4e83-b30d-56496a17915f tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:26.801065 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-9673b458-4a4f-4e83-b30d-56496a17915f tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:26.805141 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=100 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:26.810844 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-9673b458-4a4f-4e83-b30d-56496a17915f tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1553 microversion: 2.1 time: 0.156299 Jun 16 00:28:26.811415 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 75/149] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:26 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:27.096366 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-201c58a1-3b35-4ff2-b723-2e819d935413 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:27.096988 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-201c58a1-3b35-4ff2-b723-2e819d935413 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:27.103567 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-201c58a1-3b35-4ff2-b723-2e819d935413 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:27.104004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-201c58a1-3b35-4ff2-b723-2e819d935413 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:27.104821 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-201c58a1-3b35-4ff2-b723-2e819d935413 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:27.105279 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-201c58a1-3b35-4ff2-b723-2e819d935413 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:27.239486 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-201c58a1-3b35-4ff2-b723-2e819d935413 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:27.246891 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-201c58a1-3b35-4ff2-b723-2e819d935413 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.154442 Jun 16 00:28:27.247443 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 75/150] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:27 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:27.827846 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8c927c59-bddd-4add-93da-0218dfe8dda8 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:27.828473 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-8c927c59-bddd-4add-93da-0218dfe8dda8 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:27.835172 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8c927c59-bddd-4add-93da-0218dfe8dda8 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:27.835672 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8c927c59-bddd-4add-93da-0218dfe8dda8 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:27.836426 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8c927c59-bddd-4add-93da-0218dfe8dda8 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:27.836857 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8c927c59-bddd-4add-93da-0218dfe8dda8 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:27.966683 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-8c927c59-bddd-4add-93da-0218dfe8dda8 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:27.974729 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-8c927c59-bddd-4add-93da-0218dfe8dda8 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1553 microversion: 2.1 time: 0.150724 Jun 16 00:28:27.975274 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 76/151] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:27 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:28.263703 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-2aa353c1-3d62-4fb8-990e-fdbd47ea41d1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:28.264221 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-2aa353c1-3d62-4fb8-990e-fdbd47ea41d1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:28.270134 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2aa353c1-3d62-4fb8-990e-fdbd47ea41d1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:28.270577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2aa353c1-3d62-4fb8-990e-fdbd47ea41d1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:28.271319 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2aa353c1-3d62-4fb8-990e-fdbd47ea41d1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:28.271739 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2aa353c1-3d62-4fb8-990e-fdbd47ea41d1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:28.402067 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-2aa353c1-3d62-4fb8-990e-fdbd47ea41d1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:28.409468 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-2aa353c1-3d62-4fb8-990e-fdbd47ea41d1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.149659 Jun 16 00:28:28.410012 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 76/152] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:28 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:28.992541 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-6b9dda4f-a0e2-4db9-be2e-504b0cb09f36 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:28.993172 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-6b9dda4f-a0e2-4db9-be2e-504b0cb09f36 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:28.999784 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6b9dda4f-a0e2-4db9-be2e-504b0cb09f36 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:29.000224 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6b9dda4f-a0e2-4db9-be2e-504b0cb09f36 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:29.001016 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6b9dda4f-a0e2-4db9-be2e-504b0cb09f36 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:29.001450 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6b9dda4f-a0e2-4db9-be2e-504b0cb09f36 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:29.145629 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-6b9dda4f-a0e2-4db9-be2e-504b0cb09f36 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:29.153908 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-6b9dda4f-a0e2-4db9-be2e-504b0cb09f36 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1553 microversion: 2.1 time: 0.165214 Jun 16 00:28:29.154463 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 77/153] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:28 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:29.426841 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-945b69c7-2da9-4d98-8b55-0ae265ce348d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:29.427443 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-945b69c7-2da9-4d98-8b55-0ae265ce348d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:29.434159 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-945b69c7-2da9-4d98-8b55-0ae265ce348d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:29.434661 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-945b69c7-2da9-4d98-8b55-0ae265ce348d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:29.435408 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-945b69c7-2da9-4d98-8b55-0ae265ce348d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:29.435833 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-945b69c7-2da9-4d98-8b55-0ae265ce348d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:29.570855 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-945b69c7-2da9-4d98-8b55-0ae265ce348d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:29.578847 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-945b69c7-2da9-4d98-8b55-0ae265ce348d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.155766 Jun 16 00:28:29.579579 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 77/154] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:29 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:30.170420 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b6ebe969-030b-41e0-b2cf-dacb4580ded6 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:30.171026 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-b6ebe969-030b-41e0-b2cf-dacb4580ded6 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:30.178032 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b6ebe969-030b-41e0-b2cf-dacb4580ded6 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:30.178443 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b6ebe969-030b-41e0-b2cf-dacb4580ded6 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:30.179377 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b6ebe969-030b-41e0-b2cf-dacb4580ded6 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:30.180162 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b6ebe969-030b-41e0-b2cf-dacb4580ded6 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:30.316680 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b6ebe969-030b-41e0-b2cf-dacb4580ded6 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:30.325083 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-b6ebe969-030b-41e0-b2cf-dacb4580ded6 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1553 microversion: 2.1 time: 0.158405 Jun 16 00:28:30.325641 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 78/155] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:30 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:30.595415 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-14583d69-26ff-42f2-b20e-50b7d1ee74d7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:30.596027 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-14583d69-26ff-42f2-b20e-50b7d1ee74d7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:30.602153 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-14583d69-26ff-42f2-b20e-50b7d1ee74d7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:30.602609 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-14583d69-26ff-42f2-b20e-50b7d1ee74d7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:30.603366 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-14583d69-26ff-42f2-b20e-50b7d1ee74d7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:30.603824 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-14583d69-26ff-42f2-b20e-50b7d1ee74d7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:30.736762 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-14583d69-26ff-42f2-b20e-50b7d1ee74d7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:30.744480 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-14583d69-26ff-42f2-b20e-50b7d1ee74d7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.152888 Jun 16 00:28:30.745063 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 78/156] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:30 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:31.343282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-dd1c7df4-6442-4642-85c4-ccdfb043df5a tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:31.344608 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-dd1c7df4-6442-4642-85c4-ccdfb043df5a tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:31.351485 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-dd1c7df4-6442-4642-85c4-ccdfb043df5a tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:31.351922 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-dd1c7df4-6442-4642-85c4-ccdfb043df5a tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:31.352693 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-dd1c7df4-6442-4642-85c4-ccdfb043df5a tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:31.353152 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-dd1c7df4-6442-4642-85c4-ccdfb043df5a tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:31.601858 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-dd1c7df4-6442-4642-85c4-ccdfb043df5a tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:31.609869 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-dd1c7df4-6442-4642-85c4-ccdfb043df5a tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1553 microversion: 2.1 time: 0.270986 Jun 16 00:28:31.610438 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 79/157] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:31 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1553 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:31.749309 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-220d6ba1-767d-4369-822f-2d994bce8d62 req-7c4b8a13-4cd8-4130-9d03-02060cc179c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d3e518-8904-49a1-82d2-c59a7ab09acf", "name": "network-vif-deleted", "tag": "0f60693e-4470-4a5b-b3e8-6439aa2de3f0"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:28:31.761850 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-66f460be-e09a-4853-b3ae-e0ec34c780d6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:31.762453 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-66f460be-e09a-4853-b3ae-e0ec34c780d6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:31.770659 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-220d6ba1-767d-4369-822f-2d994bce8d62 req-7c4b8a13-4cd8-4130-9d03-02060cc179c5 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:31.771092 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-220d6ba1-767d-4369-822f-2d994bce8d62 req-7c4b8a13-4cd8-4130-9d03-02060cc179c5 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:31.773578 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-66f460be-e09a-4853-b3ae-e0ec34c780d6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:31.774460 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-66f460be-e09a-4853-b3ae-e0ec34c780d6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:31.775444 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-66f460be-e09a-4853-b3ae-e0ec34c780d6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:31.776077 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-66f460be-e09a-4853-b3ae-e0ec34c780d6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:31.792802 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-220d6ba1-767d-4369-822f-2d994bce8d62 req-7c4b8a13-4cd8-4130-9d03-02060cc179c5 service nova] Creating event network-vif-deleted:0f60693e-4470-4a5b-b3e8-6439aa2de3f0 for instance a3d3e518-8904-49a1-82d2-c59a7ab09acf on hv-cinder-84599 Jun 16 00:28:31.800540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-220d6ba1-767d-4369-822f-2d994bce8d62 req-7c4b8a13-4cd8-4130-9d03-02060cc179c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058695 Jun 16 00:28:31.801411 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 79/158] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:28:31.943710 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-66f460be-e09a-4853-b3ae-e0ec34c780d6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:31.952235 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-66f460be-e09a-4853-b3ae-e0ec34c780d6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.194322 Jun 16 00:28:31.952794 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 80/159] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:31 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:32.627959 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-c74c88e8-856c-482b-83fb-49e834e663d4 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:32.628662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-c74c88e8-856c-482b-83fb-49e834e663d4 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:32.635555 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c74c88e8-856c-482b-83fb-49e834e663d4 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:32.636003 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c74c88e8-856c-482b-83fb-49e834e663d4 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:32.636760 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c74c88e8-856c-482b-83fb-49e834e663d4 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:32.637221 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c74c88e8-856c-482b-83fb-49e834e663d4 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:32.700942 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-c74c88e8-856c-482b-83fb-49e834e663d4 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:32.708989 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-c74c88e8-856c-482b-83fb-49e834e663d4 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1346 microversion: 2.1 time: 0.085164 Jun 16 00:28:32.709556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 80/160] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:32 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:32.968791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-e59214f8-ebec-4525-b05f-825bb6625db0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:32.969429 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-e59214f8-ebec-4525-b05f-825bb6625db0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:32.976786 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e59214f8-ebec-4525-b05f-825bb6625db0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:32.977262 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e59214f8-ebec-4525-b05f-825bb6625db0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:32.978019 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e59214f8-ebec-4525-b05f-825bb6625db0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:32.978455 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e59214f8-ebec-4525-b05f-825bb6625db0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:33.110679 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-e59214f8-ebec-4525-b05f-825bb6625db0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:33.118812 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-e59214f8-ebec-4525-b05f-825bb6625db0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.153869 Jun 16 00:28:33.119508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 81/161] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:32 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:33.727489 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b298fce7-ce74-4ea1-8e22-b1360850a351 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:33.728728 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-b298fce7-ce74-4ea1-8e22-b1360850a351 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:33.734302 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b298fce7-ce74-4ea1-8e22-b1360850a351 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:33.734773 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b298fce7-ce74-4ea1-8e22-b1360850a351 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:33.735515 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b298fce7-ce74-4ea1-8e22-b1360850a351 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:33.735940 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b298fce7-ce74-4ea1-8e22-b1360850a351 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:33.803507 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-b298fce7-ce74-4ea1-8e22-b1360850a351 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:33.813654 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-b298fce7-ce74-4ea1-8e22-b1360850a351 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1346 microversion: 2.1 time: 0.090498 Jun 16 00:28:33.814224 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 81/162] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:33 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:34.135344 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-6fe7c990-6750-4a76-b09b-05c4e889c951 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:34.135942 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-6fe7c990-6750-4a76-b09b-05c4e889c951 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:34.142269 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6fe7c990-6750-4a76-b09b-05c4e889c951 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:34.142706 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6fe7c990-6750-4a76-b09b-05c4e889c951 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:34.143446 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6fe7c990-6750-4a76-b09b-05c4e889c951 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:34.143870 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6fe7c990-6750-4a76-b09b-05c4e889c951 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:34.274708 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-6fe7c990-6750-4a76-b09b-05c4e889c951 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:34.282508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-6fe7c990-6750-4a76-b09b-05c4e889c951 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.150963 Jun 16 00:28:34.283082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 82/163] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:34 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:34.830886 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-7cc19b43-e567-45bd-90af-37c4135bac73 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:34.831531 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-7cc19b43-e567-45bd-90af-37c4135bac73 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:34.839105 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7cc19b43-e567-45bd-90af-37c4135bac73 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:34.839545 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7cc19b43-e567-45bd-90af-37c4135bac73 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:34.840302 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7cc19b43-e567-45bd-90af-37c4135bac73 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:34.840728 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7cc19b43-e567-45bd-90af-37c4135bac73 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:34.905529 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-7cc19b43-e567-45bd-90af-37c4135bac73 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:34.913807 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-7cc19b43-e567-45bd-90af-37c4135bac73 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1346 microversion: 2.1 time: 0.086104 Jun 16 00:28:34.914377 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 82/164] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:34 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:35.300166 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8e1b6f5e-db50-451e-b120-7ef49e8fb0ff tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:35.300778 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-8e1b6f5e-db50-451e-b120-7ef49e8fb0ff tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:35.308053 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8e1b6f5e-db50-451e-b120-7ef49e8fb0ff tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:35.308508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8e1b6f5e-db50-451e-b120-7ef49e8fb0ff tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:35.309308 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8e1b6f5e-db50-451e-b120-7ef49e8fb0ff tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:35.309744 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8e1b6f5e-db50-451e-b120-7ef49e8fb0ff tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:35.457886 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-8e1b6f5e-db50-451e-b120-7ef49e8fb0ff tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:35.467697 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-8e1b6f5e-db50-451e-b120-7ef49e8fb0ff tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.171231 Jun 16 00:28:35.468648 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 83/165] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:35 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:35.935471 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-8fac1bfc-0909-4e04-b831-83c9ff852b87 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:35.936094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-8fac1bfc-0909-4e04-b831-83c9ff852b87 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:35.942178 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8fac1bfc-0909-4e04-b831-83c9ff852b87 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:35.942612 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8fac1bfc-0909-4e04-b831-83c9ff852b87 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:35.943350 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8fac1bfc-0909-4e04-b831-83c9ff852b87 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:35.943771 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8fac1bfc-0909-4e04-b831-83c9ff852b87 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:36.005738 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-8fac1bfc-0909-4e04-b831-83c9ff852b87 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c74d394beb4d7286563fc4a9687d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7ced4b21544bd689b6b0cae01566b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:36.013872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-8fac1bfc-0909-4e04-b831-83c9ff852b87 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 200 len: 1346 microversion: 2.1 time: 0.082265 Jun 16 00:28:36.014483 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 83/166] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:35 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 1346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:36.488817 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-74a8bdef-534e-4843-ab12-72fdad98c5e9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:36.489444 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-74a8bdef-534e-4843-ab12-72fdad98c5e9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:36.497697 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-74a8bdef-534e-4843-ab12-72fdad98c5e9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:36.498145 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-74a8bdef-534e-4843-ab12-72fdad98c5e9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:36.498911 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-74a8bdef-534e-4843-ab12-72fdad98c5e9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:36.499338 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-74a8bdef-534e-4843-ab12-72fdad98c5e9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:36.637297 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-74a8bdef-534e-4843-ab12-72fdad98c5e9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:36.644722 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-74a8bdef-534e-4843-ab12-72fdad98c5e9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.159722 Jun 16 00:28:36.645329 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 84/167] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:36 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:37.032093 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-4220e926-8cef-4a19-8a93-0180ceed0e7c tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:37.032729 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-4220e926-8cef-4a19-8a93-0180ceed0e7c tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:37.039491 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4220e926-8cef-4a19-8a93-0180ceed0e7c tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:37.039935 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4220e926-8cef-4a19-8a93-0180ceed0e7c tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:37.042068 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4220e926-8cef-4a19-8a93-0180ceed0e7c tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:37.043534 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4220e926-8cef-4a19-8a93-0180ceed0e7c tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:37.060068 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-4220e926-8cef-4a19-8a93-0180ceed0e7c tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] HTTP exception thrown: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. Jun 16 00:28:37.064819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-4220e926-8cef-4a19-8a93-0180ceed0e7c tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Request method failure captured: Jun 16 00:28:37.064819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf HTTP/1.1 Jun 16 00:28:37.064819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:28:37.064819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:28:37.064819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:28:37.064819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:28:37.064819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:28:37.064819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:28:37.064819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:28:37.064819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:28:37.064819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnjhd3Vrt3jvzv4uZUtt2g5x_uDly5eG36sIOtGBB43OK-_kGyhCyNzagx-0wvRNY_rtTfKcAjJ95cr_L1Ji4fj9XPgn6VrqFa3wbFWSomEQP9zycgPOrI--vxCCmGntWEEEowGw9ttZjvokyAml7faBa6qWmLkpaBC2Qf4Vgh88u3E Jun 16 00:28:37.064819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:28:37.064819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:28:37.064819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:28:37.064819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:28:37.064819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:28:37.064819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:28:37.064819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: 7e7ced4b21544bd689b6b0cae01566b6 Jun 16 00:28:37.064819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-DeleteServersTestJSON-1620132875 Jun 16 00:28:37.064819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:28:37.064819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:28:37.066420 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7e7ced4b21544bd689b6b0cae01566b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7e7ced4b21544bd689b6b0cae01566b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7e7ced4b21544bd689b6b0cae01566b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7e7ced4b21544bd689b6b0cae01566b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:28:37.066420 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-DeleteServersTestJSON-1620132875 Jun 16 00:28:37.066420 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: 7e7ced4b21544bd689b6b0cae01566b6 Jun 16 00:28:37.066420 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-DeleteServersTestJSON-1620132875 Jun 16 00:28:37.066420 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-DeleteServersTestJSON-1620132875-project Jun 16 00:28:37.066420 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:28:37.066420 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:28:37.066420 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: 01c74d394beb4d7286563fc4a9687d50 Jun 16 00:28:37.066420 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-DeleteServersTestJSON-1620132875-project Jun 16 00:28:37.066420 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:28:37.066420 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. Jun 16 00:28:37.066420 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': 'a3d3e518-8904-49a1-82d2-c59a7ab09acf'} Jun 16 00:28:37.067258 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:28:37.067258 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:37.067258 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:28:37.067258 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:28:37.067258 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:28:37.067258 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:28:37.067258 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:28:37.067258 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:28:37.067258 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:28:37.067258 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:28:37.067258 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. Jun 16 00:28:37.067258 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:28:37.067258 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:37.067258 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:28:37.067258 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:37.067258 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:37.067258 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:37.067258 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:28:37.067258 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:28:37.067258 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:28:37.068956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:28:37.068956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:28:37.068956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:28:37.068956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:28:37.068956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:28:37.068956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:28:37.068956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:28:37.068956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. Jun 16 00:28:37.068956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:28:37.068956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:37.068956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:28:37.068956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:37.068956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:37.068956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:37.068956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:28:37.068956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:28:37.068956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. Jun 16 00:28:37.068956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:28:37.070218 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-4220e926-8cef-4a19-8a93-0180ceed0e7c tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Returning 404 to user: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:28:37.070218 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-4220e926-8cef-4a19-8a93-0180ceed0e7c tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 404 len: 111 microversion: 2.1 time: 0.038137 Jun 16 00:28:37.070218 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 84/168] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:37 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:28:37.190059 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-7ab028ad-618f-4061-b17d-dbc1d815790e tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:37.191066 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-7ab028ad-618f-4061-b17d-dbc1d815790e tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:37.197326 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7ab028ad-618f-4061-b17d-dbc1d815790e tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:37.197767 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7ab028ad-618f-4061-b17d-dbc1d815790e tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:37.198515 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7ab028ad-618f-4061-b17d-dbc1d815790e tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:37.198965 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7ab028ad-618f-4061-b17d-dbc1d815790e tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:37.211813 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-7ab028ad-618f-4061-b17d-dbc1d815790e tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] HTTP exception thrown: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. Jun 16 00:28:37.216003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-7ab028ad-618f-4061-b17d-dbc1d815790e tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Request method failure captured: Jun 16 00:28:37.216003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf/os-volume_attachments HTTP/1.1 Jun 16 00:28:37.216003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:28:37.216003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:28:37.216003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:28:37.216003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:28:37.216003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:28:37.216003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:28:37.216003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:28:37.216003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:28:37.216003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnjhd3Vrt3jvzv4uZUtt2g5x_uDly5eG36sIOtGBB43OK-_kGyhCyNzagx-0wvRNY_rtTfKcAjJ95cr_L1Ji4fj9XPgn6VrqFa3wbFWSomEQP9zycgPOrI--vxCCmGntWEEEowGw9ttZjvokyAml7faBa6qWmLkpaBC2Qf4Vgh88u3E Jun 16 00:28:37.216003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:28:37.216003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:28:37.216003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:28:37.216003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:28:37.216003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:28:37.216003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:28:37.216003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: 7e7ced4b21544bd689b6b0cae01566b6 Jun 16 00:28:37.216003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-DeleteServersTestJSON-1620132875 Jun 16 00:28:37.216003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:28:37.216003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:28:37.217312 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7e7ced4b21544bd689b6b0cae01566b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7e7ced4b21544bd689b6b0cae01566b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7e7ced4b21544bd689b6b0cae01566b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7e7ced4b21544bd689b6b0cae01566b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:28:37.217312 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-DeleteServersTestJSON-1620132875 Jun 16 00:28:37.217312 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: 7e7ced4b21544bd689b6b0cae01566b6 Jun 16 00:28:37.217312 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-DeleteServersTestJSON-1620132875 Jun 16 00:28:37.217312 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-DeleteServersTestJSON-1620132875-project Jun 16 00:28:37.217312 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:28:37.217312 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:28:37.217312 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: 01c74d394beb4d7286563fc4a9687d50 Jun 16 00:28:37.217312 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-DeleteServersTestJSON-1620132875-project Jun 16 00:28:37.217312 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: > Jun 16 00:28:37.217312 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. Jun 16 00:28:37.217312 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'server_id': 'a3d3e518-8904-49a1-82d2-c59a7ab09acf'} Jun 16 00:28:37.217980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:28:37.217980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:37.217980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:28:37.217980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:28:37.217980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:28:37.217980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:28:37.217980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:28:37.217980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:28:37.217980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:28:37.217980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:28:37.217980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. Jun 16 00:28:37.217980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:28:37.217980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:37.217980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:28:37.217980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:37.217980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:37.217980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:37.217980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:28:37.217980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:28:37.217980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:28:37.219270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:28:37.219270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 00:28:37.219270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:28:37.219270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 00:28:37.219270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:28:37.219270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 16 00:28:37.219270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 16 00:28:37.219270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:28:37.219270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:28:37.219270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. Jun 16 00:28:37.219270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:28:37.219270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:37.219270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:28:37.219270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:37.219270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:37.219270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:37.219270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:28:37.219270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:28:37.219270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. Jun 16 00:28:37.219270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:28:37.220612 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-7ab028ad-618f-4061-b17d-dbc1d815790e tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Returning 404 to user: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:28:37.220612 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-7ab028ad-618f-4061-b17d-dbc1d815790e tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031317 Jun 16 00:28:37.220612 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 85/169] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Jun 16 00:28:37 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:28:37.663526 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b862be42-1fc6-4f02-984d-28e5e171504b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:37.664195 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-b862be42-1fc6-4f02-984d-28e5e171504b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:37.689682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b862be42-1fc6-4f02-984d-28e5e171504b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:37.690409 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b862be42-1fc6-4f02-984d-28e5e171504b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:37.691197 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b862be42-1fc6-4f02-984d-28e5e171504b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:37.691631 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b862be42-1fc6-4f02-984d-28e5e171504b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:37.848539 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-b862be42-1fc6-4f02-984d-28e5e171504b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:37.857011 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-b862be42-1fc6-4f02-984d-28e5e171504b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.197456 Jun 16 00:28:37.857777 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 85/170] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:37 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:38.419670 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-0ba4e09c-9b91-4d2e-b928-fe9fb02966d1 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:38.420784 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-0ba4e09c-9b91-4d2e-b928-fe9fb02966d1 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:38.427874 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0ba4e09c-9b91-4d2e-b928-fe9fb02966d1 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:38.428324 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0ba4e09c-9b91-4d2e-b928-fe9fb02966d1 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:38.430326 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0ba4e09c-9b91-4d2e-b928-fe9fb02966d1 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:38.430820 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0ba4e09c-9b91-4d2e-b928-fe9fb02966d1 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:38.446661 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-0ba4e09c-9b91-4d2e-b928-fe9fb02966d1 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] HTTP exception thrown: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. Jun 16 00:28:38.448831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-0ba4e09c-9b91-4d2e-b928-fe9fb02966d1 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Request method failure captured: Jun 16 00:28:38.448831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: DELETE /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf HTTP/1.1 Jun 16 00:28:38.448831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:28:38.448831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:28:38.448831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:28:38.448831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:28:38.448831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:28:38.448831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:28:38.448831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:28:38.448831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:28:38.448831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnjhd3Vrt3jvzv4uZUtt2g5x_uDly5eG36sIOtGBB43OK-_kGyhCyNzagx-0wvRNY_rtTfKcAjJ95cr_L1Ji4fj9XPgn6VrqFa3wbFWSomEQP9zycgPOrI--vxCCmGntWEEEowGw9ttZjvokyAml7faBa6qWmLkpaBC2Qf4Vgh88u3E Jun 16 00:28:38.448831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:28:38.448831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:28:38.448831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:28:38.448831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:28:38.448831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:28:38.448831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:28:38.448831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: 7e7ced4b21544bd689b6b0cae01566b6 Jun 16 00:28:38.448831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-DeleteServersTestJSON-1620132875 Jun 16 00:28:38.448831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:28:38.448831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:28:38.451113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7e7ced4b21544bd689b6b0cae01566b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7e7ced4b21544bd689b6b0cae01566b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7e7ced4b21544bd689b6b0cae01566b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7e7ced4b21544bd689b6b0cae01566b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:28:38.451113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-DeleteServersTestJSON-1620132875 Jun 16 00:28:38.451113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: 7e7ced4b21544bd689b6b0cae01566b6 Jun 16 00:28:38.451113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-DeleteServersTestJSON-1620132875 Jun 16 00:28:38.451113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-DeleteServersTestJSON-1620132875-project Jun 16 00:28:38.451113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:28:38.451113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:28:38.451113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: 01c74d394beb4d7286563fc4a9687d50 Jun 16 00:28:38.451113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-DeleteServersTestJSON-1620132875-project Jun 16 00:28:38.451113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: > Jun 16 00:28:38.451113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. Jun 16 00:28:38.451113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'id': 'a3d3e518-8904-49a1-82d2-c59a7ab09acf'} Jun 16 00:28:38.452296 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:28:38.452296 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:38.452296 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:28:38.452296 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:28:38.452296 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:28:38.452296 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:28:38.452296 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:28:38.452296 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:28:38.452296 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:28:38.452296 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:28:38.452296 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. Jun 16 00:28:38.452296 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:28:38.452296 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:38.452296 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:28:38.452296 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:38.452296 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:38.452296 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:38.452296 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:28:38.452296 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:28:38.452296 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:28:38.454493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:28:38.454493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:28:38.454493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:28:38.454493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:28:38.454493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:28:38.454493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:28:38.454493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:28:38.454493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:28:38.454493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:28:38.454493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. Jun 16 00:28:38.454493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:28:38.454493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:38.454493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:28:38.454493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:38.454493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:38.454493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:38.454493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:28:38.454493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:28:38.454493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. Jun 16 00:28:38.454493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:28:38.456673 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-0ba4e09c-9b91-4d2e-b928-fe9fb02966d1 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Returning 404 to user: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:28:38.456673 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-0ba4e09c-9b91-4d2e-b928-fe9fb02966d1 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 404 len: 111 microversion: 2.1 time: 0.035108 Jun 16 00:28:38.456673 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 86/171] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:28:38 2022] DELETE /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:28:38.458756 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-69ec52c6-de3a-450c-9726-8b064c231531 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:38.459357 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-69ec52c6-de3a-450c-9726-8b064c231531 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] [instance: a3d3e518-8904-49a1-82d2-c59a7ab09acf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:38.466967 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-69ec52c6-de3a-450c-9726-8b064c231531 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:38.467413 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-69ec52c6-de3a-450c-9726-8b064c231531 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:38.468237 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-69ec52c6-de3a-450c-9726-8b064c231531 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:38.468624 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-69ec52c6-de3a-450c-9726-8b064c231531 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:38.485897 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-69ec52c6-de3a-450c-9726-8b064c231531 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] HTTP exception thrown: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. Jun 16 00:28:38.487424 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-69ec52c6-de3a-450c-9726-8b064c231531 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Request method failure captured: Jun 16 00:28:38.487424 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf HTTP/1.1 Jun 16 00:28:38.487424 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:28:38.487424 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:28:38.487424 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:28:38.487424 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:28:38.487424 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:28:38.487424 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:28:38.487424 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:28:38.487424 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:28:38.487424 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnjhd3Vrt3jvzv4uZUtt2g5x_uDly5eG36sIOtGBB43OK-_kGyhCyNzagx-0wvRNY_rtTfKcAjJ95cr_L1Ji4fj9XPgn6VrqFa3wbFWSomEQP9zycgPOrI--vxCCmGntWEEEowGw9ttZjvokyAml7faBa6qWmLkpaBC2Qf4Vgh88u3E Jun 16 00:28:38.487424 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:28:38.487424 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:28:38.487424 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:28:38.487424 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:28:38.487424 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:28:38.487424 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:28:38.487424 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: 7e7ced4b21544bd689b6b0cae01566b6 Jun 16 00:28:38.487424 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-DeleteServersTestJSON-1620132875 Jun 16 00:28:38.487424 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:28:38.487424 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:28:38.488749 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7e7ced4b21544bd689b6b0cae01566b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7e7ced4b21544bd689b6b0cae01566b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7e7ced4b21544bd689b6b0cae01566b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7e7ced4b21544bd689b6b0cae01566b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:28:38.488749 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-DeleteServersTestJSON-1620132875 Jun 16 00:28:38.488749 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: 7e7ced4b21544bd689b6b0cae01566b6 Jun 16 00:28:38.488749 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-DeleteServersTestJSON-1620132875 Jun 16 00:28:38.488749 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-DeleteServersTestJSON-1620132875-project Jun 16 00:28:38.488749 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:28:38.488749 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:28:38.488749 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: 01c74d394beb4d7286563fc4a9687d50 Jun 16 00:28:38.488749 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-DeleteServersTestJSON-1620132875-project Jun 16 00:28:38.488749 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:28:38.488749 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. Jun 16 00:28:38.488749 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': 'a3d3e518-8904-49a1-82d2-c59a7ab09acf'} Jun 16 00:28:38.493198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:28:38.493198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:38.493198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:28:38.493198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:28:38.493198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:28:38.493198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:28:38.493198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:28:38.493198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:28:38.493198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:28:38.493198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:28:38.493198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. Jun 16 00:28:38.493198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:28:38.493198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:38.493198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:28:38.493198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:38.493198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:38.493198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:38.493198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:28:38.493198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:28:38.493198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:28:38.494283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:28:38.494283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:28:38.494283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:28:38.494283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:28:38.494283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:28:38.494283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:28:38.494283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:28:38.494283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. Jun 16 00:28:38.494283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:28:38.494283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:38.494283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:28:38.494283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:38.494283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:38.494283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:38.494283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:28:38.494283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:28:38.494283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. Jun 16 00:28:38.494283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:28:38.495280 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-69ec52c6-de3a-450c-9726-8b064c231531 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] Returning 404 to user: Instance a3d3e518-8904-49a1-82d2-c59a7ab09acf could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:28:38.495280 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-69ec52c6-de3a-450c-9726-8b064c231531 tempest-DeleteServersTestJSON-1620132875 tempest-DeleteServersTestJSON-1620132875-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf" status: 404 len: 111 microversion: 2.1 time: 0.033805 Jun 16 00:28:38.495280 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 86/172] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:38 2022] GET /compute/v2.1/servers/a3d3e518-8904-49a1-82d2-c59a7ab09acf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:28:38.877315 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-0345519d-9740-457e-921e-a4f822228c15 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:38.878957 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-0345519d-9740-457e-921e-a4f822228c15 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:38.886712 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0345519d-9740-457e-921e-a4f822228c15 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:38.887837 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0345519d-9740-457e-921e-a4f822228c15 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:38.890809 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0345519d-9740-457e-921e-a4f822228c15 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:38.891489 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0345519d-9740-457e-921e-a4f822228c15 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:39.233651 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0345519d-9740-457e-921e-a4f822228c15 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:39.243571 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-0345519d-9740-457e-921e-a4f822228c15 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.368789 Jun 16 00:28:39.255186 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 87/173] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:38 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:40.263413 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-9436d1c8-41ae-4982-99ac-b24028427ecd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:40.264016 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-9436d1c8-41ae-4982-99ac-b24028427ecd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:40.270468 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9436d1c8-41ae-4982-99ac-b24028427ecd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:40.270892 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9436d1c8-41ae-4982-99ac-b24028427ecd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:40.271826 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9436d1c8-41ae-4982-99ac-b24028427ecd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:40.272946 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9436d1c8-41ae-4982-99ac-b24028427ecd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:40.454673 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-9436d1c8-41ae-4982-99ac-b24028427ecd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:40.464344 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-9436d1c8-41ae-4982-99ac-b24028427ecd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.204505 Jun 16 00:28:40.465713 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 87/174] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:40 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:41.482944 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c4a109c2-0f93-4b19-9509-8c5e5197f83b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:41.484206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c4a109c2-0f93-4b19-9509-8c5e5197f83b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:41.490950 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c4a109c2-0f93-4b19-9509-8c5e5197f83b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:41.491642 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c4a109c2-0f93-4b19-9509-8c5e5197f83b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:41.492766 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c4a109c2-0f93-4b19-9509-8c5e5197f83b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:41.493365 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c4a109c2-0f93-4b19-9509-8c5e5197f83b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:41.755746 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c4a109c2-0f93-4b19-9509-8c5e5197f83b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:41.763963 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c4a109c2-0f93-4b19-9509-8c5e5197f83b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.284712 Jun 16 00:28:41.769253 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 88/175] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:41 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:42.788129 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-717bab4f-106d-48e6-957c-d186e57cad6a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:42.789880 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-717bab4f-106d-48e6-957c-d186e57cad6a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:42.794442 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:42.811561 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-717bab4f-106d-48e6-957c-d186e57cad6a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:42.812018 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-717bab4f-106d-48e6-957c-d186e57cad6a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:42.813015 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-717bab4f-106d-48e6-957c-d186e57cad6a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:42.813252 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-717bab4f-106d-48e6-957c-d186e57cad6a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:42.999011 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-717bab4f-106d-48e6-957c-d186e57cad6a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:43.010223 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-717bab4f-106d-48e6-957c-d186e57cad6a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.232686 Jun 16 00:28:43.011153 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 88/176] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:42 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:44.030110 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-357ff0b7-bb81-41d4-a91c-90da12803fb1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:44.030714 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-357ff0b7-bb81-41d4-a91c-90da12803fb1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:44.034901 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=42 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:44.041386 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-357ff0b7-bb81-41d4-a91c-90da12803fb1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:44.041934 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-357ff0b7-bb81-41d4-a91c-90da12803fb1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:44.042706 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-357ff0b7-bb81-41d4-a91c-90da12803fb1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:44.043298 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-357ff0b7-bb81-41d4-a91c-90da12803fb1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:44.203523 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-357ff0b7-bb81-41d4-a91c-90da12803fb1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:44.211905 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-357ff0b7-bb81-41d4-a91c-90da12803fb1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.187566 Jun 16 00:28:44.223305 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 89/177] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:44 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:45.230296 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-57653726-9398-48e6-b370-a038526e0630 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:45.230901 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-57653726-9398-48e6-b370-a038526e0630 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:45.256106 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-57653726-9398-48e6-b370-a038526e0630 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:45.256608 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-57653726-9398-48e6-b370-a038526e0630 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:45.257579 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-57653726-9398-48e6-b370-a038526e0630 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:45.258010 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-57653726-9398-48e6-b370-a038526e0630 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:45.411751 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-57653726-9398-48e6-b370-a038526e0630 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:45.420787 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-57653726-9398-48e6-b370-a038526e0630 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.195079 Jun 16 00:28:45.431381 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 89/178] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:45 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:46.439061 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-7f023e81-39dd-45ac-96d5-04b4f331cc63 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:46.439704 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-7f023e81-39dd-45ac-96d5-04b4f331cc63 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:46.449693 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7f023e81-39dd-45ac-96d5-04b4f331cc63 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:46.450333 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7f023e81-39dd-45ac-96d5-04b4f331cc63 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:46.451305 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7f023e81-39dd-45ac-96d5-04b4f331cc63 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:46.452553 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7f023e81-39dd-45ac-96d5-04b4f331cc63 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:46.691106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-7f023e81-39dd-45ac-96d5-04b4f331cc63 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:46.708663 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-7f023e81-39dd-45ac-96d5-04b4f331cc63 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.273690 Jun 16 00:28:46.721804 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 90/179] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:46 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:47.725928 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b21c605c-23f7-4f3e-8121-7e071003b95a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:47.729569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-b21c605c-23f7-4f3e-8121-7e071003b95a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:47.749210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b21c605c-23f7-4f3e-8121-7e071003b95a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:47.749667 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b21c605c-23f7-4f3e-8121-7e071003b95a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:47.755004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b21c605c-23f7-4f3e-8121-7e071003b95a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:47.755455 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b21c605c-23f7-4f3e-8121-7e071003b95a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:48.473314 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-b21c605c-23f7-4f3e-8121-7e071003b95a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:48.485623 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-b21c605c-23f7-4f3e-8121-7e071003b95a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.764210 Jun 16 00:28:48.487173 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 90/180] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:47 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:49.508393 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-6c34c957-269a-40ac-944e-81504dc55bf9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:49.509619 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-6c34c957-269a-40ac-944e-81504dc55bf9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:49.521456 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6c34c957-269a-40ac-944e-81504dc55bf9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:49.523217 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6c34c957-269a-40ac-944e-81504dc55bf9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:49.526729 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6c34c957-269a-40ac-944e-81504dc55bf9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:49.528985 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6c34c957-269a-40ac-944e-81504dc55bf9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:50.157656 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-6c34c957-269a-40ac-944e-81504dc55bf9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:50.176216 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-6c34c957-269a-40ac-944e-81504dc55bf9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1522 microversion: 2.1 time: 0.671510 Jun 16 00:28:50.189569 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 91/181] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:49 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1522 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:51.193860 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-6b63c575-e985-4c2e-a198-878e34076eb1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:51.196628 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-6b63c575-e985-4c2e-a198-878e34076eb1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:51.206346 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6b63c575-e985-4c2e-a198-878e34076eb1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:51.206789 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6b63c575-e985-4c2e-a198-878e34076eb1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:51.211842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6b63c575-e985-4c2e-a198-878e34076eb1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:51.212440 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6b63c575-e985-4c2e-a198-878e34076eb1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:51.487628 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-6b63c575-e985-4c2e-a198-878e34076eb1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:51.491631 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=100 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:51.513513 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-6b63c575-e985-4c2e-a198-878e34076eb1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1502 microversion: 2.1 time: 0.309241 Jun 16 00:28:51.514161 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 91/182] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:51 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1502 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:51.534374 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-a4bebea8-eefa-43ca-859c-819ca707f909 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:51.535095 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-a4bebea8-eefa-43ca-859c-819ca707f909 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:51.557105 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a4bebea8-eefa-43ca-859c-819ca707f909 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:51.558790 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a4bebea8-eefa-43ca-859c-819ca707f909 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:51.565401 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a4bebea8-eefa-43ca-859c-819ca707f909 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:51.566189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a4bebea8-eefa-43ca-859c-819ca707f909 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:51.974393 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a4bebea8-eefa-43ca-859c-819ca707f909 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:51.994941 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-a4bebea8-eefa-43ca-859c-819ca707f909 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1515 microversion: 2.1 time: 0.464416 Jun 16 00:28:51.998695 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 92/183] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:51 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1515 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:53.214604 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-a2cd0755-a85b-4e07-83df-544356dabbcb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Action: 'create', calling method: .version_select at 0x7fe705ef38b0>, body: {"keypair": {"name": "tempest-keypair-437539695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFV5KFB4sLYiRVyqqj/1vnW9VMUFkj0cP0wivn7Q46muuMSBZOV04NMH0vzm/tsLDFllS9AVSm9mFWkmM/1agdNVG4wcPIdrohzfnld7RBO79qigr26+sUYHmswDybi9zw=="}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:28:53.231950 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-a2cd0755-a85b-4e07-83df-544356dabbcb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Getting quotas for project 2d5d56c0c6444b23a1ac6cc2fcb0bb52. Resources: {'key_pairs'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:28:53.240247 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-a2cd0755-a85b-4e07-83df-544356dabbcb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Getting quotas for user 535a03ce19d346d59e6a6f6befb9dea0 and project 2d5d56c0c6444b23a1ac6cc2fcb0bb52. Resources: {'key_pairs'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:28:53.270794 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-a2cd0755-a85b-4e07-83df-544356dabbcb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.330256 Jun 16 00:28:53.271458 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 92/184] 10.222.0.23 () {60 vars in 1158 bytes} [Thu Jun 16 00:28:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:28:54.780130 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-fe1697bd-46a1-4bdc-9f79-b90ff8790921 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1889333190", "imageRef": "d9a6de24-7a5e-4f8b-b078-809c87b15d56", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b338e4d-b5e8-4121-bb8b-45875ebd0e07"}], "security_groups": [{"name": "tempest-securitygroup--33811246"}], "key_name": "tempest-keypair-437539695", "user_data": "}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:28:54.888288 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.network.neutron [None req-fe1697bd-46a1-4bdc-9f79-b90ff8790921 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] validate_networks() for [('5b338e4d-b5e8-4121-bb8b-45875ebd0e07', None, None, None, None, None)] {{(pid=124230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:28:55.384402 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-fe1697bd-46a1-4bdc-9f79-b90ff8790921 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Flavor limits 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:28:55.384825 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-fe1697bd-46a1-4bdc-9f79-b90ff8790921 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Image limits 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:28:55.385534 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-fe1697bd-46a1-4bdc-9f79-b90ff8790921 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Flavor pref 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:28:55.385973 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-fe1697bd-46a1-4bdc-9f79-b90ff8790921 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Image pref 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:28:55.386409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-fe1697bd-46a1-4bdc-9f79-b90ff8790921 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:28:55.397302 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fe1697bd-46a1-4bdc-9f79-b90ff8790921 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:55.397746 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fe1697bd-46a1-4bdc-9f79-b90ff8790921 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:55.398543 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fe1697bd-46a1-4bdc-9f79-b90ff8790921 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:55.398981 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fe1697bd-46a1-4bdc-9f79-b90ff8790921 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:55.416829 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-fe1697bd-46a1-4bdc-9f79-b90ff8790921 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Getting quotas for project 2d5d56c0c6444b23a1ac6cc2fcb0bb52. Resources: {'ram', 'cores', 'instances'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:28:55.421414 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-fe1697bd-46a1-4bdc-9f79-b90ff8790921 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Getting quotas for user 535a03ce19d346d59e6a6f6befb9dea0 and project 2d5d56c0c6444b23a1ac6cc2fcb0bb52. Resources: {'ram', 'cores', 'instances'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:28:55.442667 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-fe1697bd-46a1-4bdc-9f79-b90ff8790921 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Going to run 1 instances... {{(pid=124230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:28:55.445787 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-fe1697bd-46a1-4bdc-9f79-b90ff8790921 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d9a6de24-7a5e-4f8b-b078-809c87b15d56',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:28:55.503844 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-fe1697bd-46a1-4bdc-9f79-b90ff8790921 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.727696 Jun 16 00:28:55.504811 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 93/185] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Jun 16 00:28:54 2022] POST /compute/v2.1/servers => generated 400 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:28:55.516206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d94c6095-cffb-4ea8-80ee-8b7608c67089 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:55.517826 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-d94c6095-cffb-4ea8-80ee-8b7608c67089 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:55.601216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d94c6095-cffb-4ea8-80ee-8b7608c67089 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:55.617817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-d94c6095-cffb-4ea8-80ee-8b7608c67089 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124" status: 200 len: 1241 microversion: 2.1 time: 0.097222 Jun 16 00:28:55.629062 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 93/186] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:55 2022] GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124 => generated 1241 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:56.635696 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-f7911740-79dd-491e-9676-0c2fdd3cae0b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:56.636300 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-f7911740-79dd-491e-9676-0c2fdd3cae0b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:56.642827 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f7911740-79dd-491e-9676-0c2fdd3cae0b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:56.643508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f7911740-79dd-491e-9676-0c2fdd3cae0b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:56.644284 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f7911740-79dd-491e-9676-0c2fdd3cae0b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:56.644743 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f7911740-79dd-491e-9676-0c2fdd3cae0b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:56.665688 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=100 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:56.716871 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f7911740-79dd-491e-9676-0c2fdd3cae0b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:56.724265 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-f7911740-79dd-491e-9676-0c2fdd3cae0b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124" status: 200 len: 1293 microversion: 2.1 time: 0.093378 Jun 16 00:28:56.725898 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 94/187] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:56 2022] GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124 => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:56.900143 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-8006ef27-252c-4976-a12c-55e0edee8b35 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:28:56.901170 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-8006ef27-252c-4976-a12c-55e0edee8b35 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:56.910158 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8006ef27-252c-4976-a12c-55e0edee8b35 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:56.911111 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8006ef27-252c-4976-a12c-55e0edee8b35 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:56.912806 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8006ef27-252c-4976-a12c-55e0edee8b35 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:56.914117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8006ef27-252c-4976-a12c-55e0edee8b35 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:56.943156 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.objects.instance [None req-8006ef27-252c-4976-a12c-55e0edee8b35 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lazy-loading 'flavor' on Instance uuid c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 {{(pid=124231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:28:57.038352 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-8006ef27-252c-4976-a12c-55e0edee8b35 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "POST /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0/action" status: 200 len: 32 microversion: 2.1 time: 0.143043 Jun 16 00:28:57.038961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 94/188] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Jun 16 00:28:56 2022] POST /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0/action => generated 32 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:28:57.048427 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c546fc2e-84ee-4cdc-a066-9684fcc51a9e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:57.049077 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c546fc2e-84ee-4cdc-a066-9684fcc51a9e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:57.055603 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c546fc2e-84ee-4cdc-a066-9684fcc51a9e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:57.056054 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c546fc2e-84ee-4cdc-a066-9684fcc51a9e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:57.056812 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c546fc2e-84ee-4cdc-a066-9684fcc51a9e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:57.057274 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c546fc2e-84ee-4cdc-a066-9684fcc51a9e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:57.314653 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c546fc2e-84ee-4cdc-a066-9684fcc51a9e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:57.322745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c546fc2e-84ee-4cdc-a066-9684fcc51a9e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.278037 Jun 16 00:28:57.330855 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 95/189] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:57 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:57.747915 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-598bd041-96c6-400b-b8b1-a730737ffa0d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:57.749759 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-598bd041-96c6-400b-b8b1-a730737ffa0d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:57.768067 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-598bd041-96c6-400b-b8b1-a730737ffa0d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:57.768707 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-598bd041-96c6-400b-b8b1-a730737ffa0d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:57.769758 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-598bd041-96c6-400b-b8b1-a730737ffa0d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:57.771200 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-598bd041-96c6-400b-b8b1-a730737ffa0d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:57.934921 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-598bd041-96c6-400b-b8b1-a730737ffa0d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:57.952081 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-598bd041-96c6-400b-b8b1-a730737ffa0d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124" status: 200 len: 1299 microversion: 2.1 time: 0.211911 Jun 16 00:28:57.954729 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 95/190] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:57 2022] GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124 => generated 1299 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:58.347500 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-092c6b74-10da-4060-8d22-01791164de4c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:58.348262 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-092c6b74-10da-4060-8d22-01791164de4c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:58.358467 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-092c6b74-10da-4060-8d22-01791164de4c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:58.359092 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-092c6b74-10da-4060-8d22-01791164de4c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:58.359889 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-092c6b74-10da-4060-8d22-01791164de4c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:58.360312 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-092c6b74-10da-4060-8d22-01791164de4c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:58.512131 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-092c6b74-10da-4060-8d22-01791164de4c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:58.521066 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-092c6b74-10da-4060-8d22-01791164de4c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.177406 Jun 16 00:28:58.531477 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 96/191] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:58 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:58.973354 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-8f5cfd5d-0c34-4357-844c-77d812c578f6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:58.974144 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-8f5cfd5d-0c34-4357-844c-77d812c578f6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:58.982907 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8f5cfd5d-0c34-4357-844c-77d812c578f6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:58.983477 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8f5cfd5d-0c34-4357-844c-77d812c578f6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:58.984716 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8f5cfd5d-0c34-4357-844c-77d812c578f6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:58.985421 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8f5cfd5d-0c34-4357-844c-77d812c578f6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:59.124118 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-8f5cfd5d-0c34-4357-844c-77d812c578f6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:59.132787 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-8f5cfd5d-0c34-4357-844c-77d812c578f6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124" status: 200 len: 1365 microversion: 2.1 time: 0.165161 Jun 16 00:28:59.133393 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 96/192] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:58 2022] GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:59.539195 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-e4ca8c12-6673-4462-93e2-4da7dc219ac0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:59.540157 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-e4ca8c12-6673-4462-93e2-4da7dc219ac0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:59.546803 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e4ca8c12-6673-4462-93e2-4da7dc219ac0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:59.547244 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e4ca8c12-6673-4462-93e2-4da7dc219ac0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:59.548002 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e4ca8c12-6673-4462-93e2-4da7dc219ac0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:59.548433 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e4ca8c12-6673-4462-93e2-4da7dc219ac0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:59.688399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-e4ca8c12-6673-4462-93e2-4da7dc219ac0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:59.697891 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-e4ca8c12-6673-4462-93e2-4da7dc219ac0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.163212 Jun 16 00:28:59.698460 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 97/193] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:59 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:00.149828 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-e93a6ddf-e8b0-40ab-874d-9055a4827e2e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:00.151011 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-e93a6ddf-e8b0-40ab-874d-9055a4827e2e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:00.157503 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e93a6ddf-e8b0-40ab-874d-9055a4827e2e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:00.158121 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e93a6ddf-e8b0-40ab-874d-9055a4827e2e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:00.159120 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e93a6ddf-e8b0-40ab-874d-9055a4827e2e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:00.159787 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e93a6ddf-e8b0-40ab-874d-9055a4827e2e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:00.467256 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-e93a6ddf-e8b0-40ab-874d-9055a4827e2e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:00.480317 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-e93a6ddf-e8b0-40ab-874d-9055a4827e2e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124" status: 200 len: 1365 microversion: 2.1 time: 0.334475 Jun 16 00:29:00.481227 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 97/194] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:00 2022] GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124 => generated 1365 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:00.487177 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-d6408ad1-55ca-449a-8046-73b92ee1c341 req-0e756baf-f65b-4888-be8c-ad472619df52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "401cad35-961b-4abf-a04c-796236ed5124", "tag": "a5a85d6b-1c98-44e7-b9ae-055f24d881a9"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:29:00.497651 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-d6408ad1-55ca-449a-8046-73b92ee1c341 req-0e756baf-f65b-4888-be8c-ad472619df52 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:00.498080 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-d6408ad1-55ca-449a-8046-73b92ee1c341 req-0e756baf-f65b-4888-be8c-ad472619df52 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:00.514841 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-d6408ad1-55ca-449a-8046-73b92ee1c341 req-0e756baf-f65b-4888-be8c-ad472619df52 service nova] Creating event network-changed:a5a85d6b-1c98-44e7-b9ae-055f24d881a9 for instance 401cad35-961b-4abf-a04c-796236ed5124 on hv-cinder-84599 Jun 16 00:29:00.520510 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-d6408ad1-55ca-449a-8046-73b92ee1c341 req-0e756baf-f65b-4888-be8c-ad472619df52 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038446 Jun 16 00:29:00.522313 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 98/195] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:29:00.715301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d3a174af-fccb-4d3f-9de0-8b5c9cd4cbfd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:00.716127 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-d3a174af-fccb-4d3f-9de0-8b5c9cd4cbfd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:00.722379 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d3a174af-fccb-4d3f-9de0-8b5c9cd4cbfd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:00.723082 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d3a174af-fccb-4d3f-9de0-8b5c9cd4cbfd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:00.724044 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d3a174af-fccb-4d3f-9de0-8b5c9cd4cbfd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:00.725031 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d3a174af-fccb-4d3f-9de0-8b5c9cd4cbfd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:00.894447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d3a174af-fccb-4d3f-9de0-8b5c9cd4cbfd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:00.905359 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-d3a174af-fccb-4d3f-9de0-8b5c9cd4cbfd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.193972 Jun 16 00:29:00.911337 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 98/196] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:00 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:01.498210 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-0ec8c2d3-7aee-4000-b215-2fc2b435977d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:01.499085 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-0ec8c2d3-7aee-4000-b215-2fc2b435977d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:01.505673 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0ec8c2d3-7aee-4000-b215-2fc2b435977d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:01.506779 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0ec8c2d3-7aee-4000-b215-2fc2b435977d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:01.507623 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0ec8c2d3-7aee-4000-b215-2fc2b435977d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:01.508129 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0ec8c2d3-7aee-4000-b215-2fc2b435977d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:01.730343 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0ec8c2d3-7aee-4000-b215-2fc2b435977d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:01.742529 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-0ec8c2d3-7aee-4000-b215-2fc2b435977d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124" status: 200 len: 1365 microversion: 2.1 time: 0.249086 Jun 16 00:29:01.743111 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 99/197] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:01 2022] GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124 => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:01.928304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-ef837464-2c30-41ee-9848-3919590b2199 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:01.929392 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-ef837464-2c30-41ee-9848-3919590b2199 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:01.935116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ef837464-2c30-41ee-9848-3919590b2199 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:01.935770 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ef837464-2c30-41ee-9848-3919590b2199 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:01.936521 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ef837464-2c30-41ee-9848-3919590b2199 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:01.937105 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ef837464-2c30-41ee-9848-3919590b2199 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:02.142950 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-ef837464-2c30-41ee-9848-3919590b2199 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:02.151493 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-ef837464-2c30-41ee-9848-3919590b2199 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.228163 Jun 16 00:29:02.152142 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 99/198] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:01 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:02.540800 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-3a5f9cc9-84c2-49ae-b68e-998886175050 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1979155381", "imageRef": "d9a6de24-7a5e-4f8b-b078-809c87b15d56", "flavorRef": "452", "networks": [{"uuid": "dd5ef2eb-9bfb-4b81-a8ae-1fa0ffb5bea4"}]}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:29:02.597521 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.network.neutron [None req-3a5f9cc9-84c2-49ae-b68e-998886175050 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] validate_networks() for [('dd5ef2eb-9bfb-4b81-a8ae-1fa0ffb5bea4', None, None, None, None, None)] {{(pid=124230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:29:02.764041 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-3aea57c0-30f1-4e28-984c-d853ddea7d62 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:02.765378 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-3aea57c0-30f1-4e28-984c-d853ddea7d62 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:02.773761 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3aea57c0-30f1-4e28-984c-d853ddea7d62 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:02.775182 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3aea57c0-30f1-4e28-984c-d853ddea7d62 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:02.776159 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3aea57c0-30f1-4e28-984c-d853ddea7d62 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:02.776829 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3aea57c0-30f1-4e28-984c-d853ddea7d62 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:03.262834 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-3aea57c0-30f1-4e28-984c-d853ddea7d62 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:03.279362 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-3aea57c0-30f1-4e28-984c-d853ddea7d62 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124" status: 200 len: 1365 microversion: 2.1 time: 0.522354 Jun 16 00:29:03.280166 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 100/199] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:02 2022] GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124 => generated 1365 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:03.284345 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-3a5f9cc9-84c2-49ae-b68e-998886175050 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Flavor limits 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:29:03.284954 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-3a5f9cc9-84c2-49ae-b68e-998886175050 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Image limits 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:29:03.285616 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-3a5f9cc9-84c2-49ae-b68e-998886175050 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Flavor pref 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:29:03.286316 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-3a5f9cc9-84c2-49ae-b68e-998886175050 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Image pref 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:29:03.286434 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-9efccb50-20a8-4bb8-b8bc-c6a976f17681 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:03.287144 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-3a5f9cc9-84c2-49ae-b68e-998886175050 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:29:03.287404 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-9efccb50-20a8-4bb8-b8bc-c6a976f17681 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:03.295435 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9efccb50-20a8-4bb8-b8bc-c6a976f17681 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:03.296436 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9efccb50-20a8-4bb8-b8bc-c6a976f17681 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:03.297488 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9efccb50-20a8-4bb8-b8bc-c6a976f17681 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:03.298133 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9efccb50-20a8-4bb8-b8bc-c6a976f17681 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:03.306207 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3a5f9cc9-84c2-49ae-b68e-998886175050 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:03.306660 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3a5f9cc9-84c2-49ae-b68e-998886175050 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:03.307507 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3a5f9cc9-84c2-49ae-b68e-998886175050 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:03.307937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3a5f9cc9-84c2-49ae-b68e-998886175050 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:03.336716 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-3a5f9cc9-84c2-49ae-b68e-998886175050 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Getting quotas for project c8055262b50d4e93b290315d0e57bd70. Resources: {'ram', 'cores', 'instances'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:29:03.342197 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-3a5f9cc9-84c2-49ae-b68e-998886175050 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Getting quotas for user ac38b6c63c1649d68302de51cc3424c1 and project c8055262b50d4e93b290315d0e57bd70. Resources: {'ram', 'cores', 'instances'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:29:03.346075 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-9efccb50-20a8-4bb8-b8bc-c6a976f17681 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7/ips" status: 200 len: 153 microversion: 2.20 time: 0.064517 Jun 16 00:29:03.346856 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 101/200] 10.222.0.23 () {60 vars in 1288 bytes} [Thu Jun 16 00:29:03 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7/ips => generated 153 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:29:03.358021 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-8e923d82-e6b1-4ec1-be97-62bf7c757bd5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:03.358934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-8e923d82-e6b1-4ec1-be97-62bf7c757bd5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:03.368096 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8e923d82-e6b1-4ec1-be97-62bf7c757bd5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:03.368971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8e923d82-e6b1-4ec1-be97-62bf7c757bd5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:03.370913 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8e923d82-e6b1-4ec1-be97-62bf7c757bd5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:03.371612 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8e923d82-e6b1-4ec1-be97-62bf7c757bd5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:03.395523 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-3a5f9cc9-84c2-49ae-b68e-998886175050 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Going to run 1 instances... {{(pid=124230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:29:03.409754 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-3a5f9cc9-84c2-49ae-b68e-998886175050 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d9a6de24-7a5e-4f8b-b078-809c87b15d56',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:29:03.516442 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-3a5f9cc9-84c2-49ae-b68e-998886175050 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.979313 Jun 16 00:29:03.517710 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 100/201] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Jun 16 00:29:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:29:03.559341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-e0dffe15-db2b-4caa-9a4e-8cd8a9cae32b tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:03.561036 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-e0dffe15-db2b-4caa-9a4e-8cd8a9cae32b tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:03.676788 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-8e923d82-e6b1-4ec1-be97-62bf7c757bd5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:03.692676 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-8e923d82-e6b1-4ec1-be97-62bf7c757bd5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.344728 Jun 16 00:29:03.696512 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 102/202] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:03 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:03.743234 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-e0dffe15-db2b-4caa-9a4e-8cd8a9cae32b tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:03.752090 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-e0dffe15-db2b-4caa-9a4e-8cd8a9cae32b tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1214 microversion: 2.1 time: 0.226554 Jun 16 00:29:03.764742 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 101/203] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:03 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1214 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:04.312553 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-5cf3a01d-4354-4088-b5bd-b8f3c26e95b6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:04.314698 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-5cf3a01d-4354-4088-b5bd-b8f3c26e95b6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:04.340615 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5cf3a01d-4354-4088-b5bd-b8f3c26e95b6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:04.341825 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5cf3a01d-4354-4088-b5bd-b8f3c26e95b6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:04.344214 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5cf3a01d-4354-4088-b5bd-b8f3c26e95b6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:04.346315 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5cf3a01d-4354-4088-b5bd-b8f3c26e95b6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:04.583459 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-5cf3a01d-4354-4088-b5bd-b8f3c26e95b6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:04.593913 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-5cf3a01d-4354-4088-b5bd-b8f3c26e95b6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124" status: 200 len: 1365 microversion: 2.1 time: 0.295731 Jun 16 00:29:04.594522 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 103/204] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:04 2022] GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124 => generated 1365 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:04.712346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-0c2155f8-8324-4f1b-a1ce-791f824ea5e2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:04.712976 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-0c2155f8-8324-4f1b-a1ce-791f824ea5e2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:04.719925 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0c2155f8-8324-4f1b-a1ce-791f824ea5e2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:04.720747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0c2155f8-8324-4f1b-a1ce-791f824ea5e2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:04.722132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0c2155f8-8324-4f1b-a1ce-791f824ea5e2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:04.722522 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0c2155f8-8324-4f1b-a1ce-791f824ea5e2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:04.772512 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-77cafd4f-3b57-4e12-80c2-53b1f3826bb0 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:04.773467 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-77cafd4f-3b57-4e12-80c2-53b1f3826bb0 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:04.781411 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-77cafd4f-3b57-4e12-80c2-53b1f3826bb0 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:04.782191 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-77cafd4f-3b57-4e12-80c2-53b1f3826bb0 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:04.783272 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-77cafd4f-3b57-4e12-80c2-53b1f3826bb0 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:04.783850 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-77cafd4f-3b57-4e12-80c2-53b1f3826bb0 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:04.857881 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-77cafd4f-3b57-4e12-80c2-53b1f3826bb0 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:04.867131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-77cafd4f-3b57-4e12-80c2-53b1f3826bb0 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1266 microversion: 2.1 time: 0.099287 Jun 16 00:29:04.877093 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 104/205] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:04 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:04.895649 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0c2155f8-8324-4f1b-a1ce-791f824ea5e2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:04.916429 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-0c2155f8-8324-4f1b-a1ce-791f824ea5e2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.207814 Jun 16 00:29:04.926487 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 102/206] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:04 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:05.612376 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-4fc81eca-a0e1-4131-a328-4757c0f6e7eb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:05.613485 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-4fc81eca-a0e1-4131-a328-4757c0f6e7eb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:05.616948 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=6 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:05.623243 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4fc81eca-a0e1-4131-a328-4757c0f6e7eb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:05.625045 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4fc81eca-a0e1-4131-a328-4757c0f6e7eb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:05.626544 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4fc81eca-a0e1-4131-a328-4757c0f6e7eb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:05.627218 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4fc81eca-a0e1-4131-a328-4757c0f6e7eb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:05.711753 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d2147f41-65d8-4359-97cf-3b6b5f6f9c70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:29:05.713236 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d2147f41-65d8-4359-97cf-3b6b5f6f9c70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:05.735038 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d2147f41-65d8-4359-97cf-3b6b5f6f9c70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:05.735489 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d2147f41-65d8-4359-97cf-3b6b5f6f9c70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:05.736758 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d2147f41-65d8-4359-97cf-3b6b5f6f9c70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:05.736758 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d2147f41-65d8-4359-97cf-3b6b5f6f9c70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:05.795569 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.objects.instance [None req-d2147f41-65d8-4359-97cf-3b6b5f6f9c70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lazy-loading 'flavor' on Instance uuid 6b227643-24e7-44b6-acf7-d3801014a8c7 {{(pid=124230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:29:05.822945 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-4fc81eca-a0e1-4131-a328-4757c0f6e7eb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:05.832232 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-4fc81eca-a0e1-4131-a328-4757c0f6e7eb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124" status: 200 len: 1365 microversion: 2.1 time: 0.224954 Jun 16 00:29:05.832817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 105/207] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:05 2022] GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:05.884656 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-178d2aa2-d51c-4adf-b941-e69687ad848a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:05.885635 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-178d2aa2-d51c-4adf-b941-e69687ad848a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:05.892274 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-178d2aa2-d51c-4adf-b941-e69687ad848a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:05.894923 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-178d2aa2-d51c-4adf-b941-e69687ad848a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:05.896069 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-178d2aa2-d51c-4adf-b941-e69687ad848a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:05.897012 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-178d2aa2-d51c-4adf-b941-e69687ad848a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:06.249736 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-178d2aa2-d51c-4adf-b941-e69687ad848a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:06.261354 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-178d2aa2-d51c-4adf-b941-e69687ad848a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1314 microversion: 2.1 time: 0.381083 Jun 16 00:29:06.273306 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 106/208] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:05 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:06.277198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-16274abc-43dc-47dc-8253-1bc795fc909e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:06.279351 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-16274abc-43dc-47dc-8253-1bc795fc909e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:06.295653 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-16274abc-43dc-47dc-8253-1bc795fc909e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:06.297220 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-16274abc-43dc-47dc-8253-1bc795fc909e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:06.298296 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-16274abc-43dc-47dc-8253-1bc795fc909e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:06.300813 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-16274abc-43dc-47dc-8253-1bc795fc909e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:06.477674 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d2147f41-65d8-4359-97cf-3b6b5f6f9c70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "POST /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7/action" status: 202 len: 0 microversion: 2.20 time: 0.771877 Jun 16 00:29:06.480926 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 103/209] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Jun 16 00:29:05 2022] POST /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7/action => generated 0 bytes in 774 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:29:06.490358 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-9cb5ac98-6243-41a1-b7e1-e6ce4bc44127 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:06.491382 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-9cb5ac98-6243-41a1-b7e1-e6ce4bc44127 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:06.503158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9cb5ac98-6243-41a1-b7e1-e6ce4bc44127 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:06.504274 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9cb5ac98-6243-41a1-b7e1-e6ce4bc44127 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:06.506137 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9cb5ac98-6243-41a1-b7e1-e6ce4bc44127 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:06.508397 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9cb5ac98-6243-41a1-b7e1-e6ce4bc44127 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:06.618370 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-16274abc-43dc-47dc-8253-1bc795fc909e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:06.628061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-16274abc-43dc-47dc-8253-1bc795fc909e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.360270 Jun 16 00:29:06.629105 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 107/210] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:06 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:06.719388 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-cc153c43-e425-4cba-a894-5bd311203e83 req-3845bb72-027e-4d34-ab33-cb00b6f5a936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401cad35-961b-4abf-a04c-796236ed5124", "name": "network-vif-plugged", "status": "completed", "tag": "a5a85d6b-1c98-44e7-b9ae-055f24d881a9"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:29:06.741818 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-cc153c43-e425-4cba-a894-5bd311203e83 req-3845bb72-027e-4d34-ab33-cb00b6f5a936 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:06.742265 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-cc153c43-e425-4cba-a894-5bd311203e83 req-3845bb72-027e-4d34-ab33-cb00b6f5a936 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:06.754365 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-cc153c43-e425-4cba-a894-5bd311203e83 req-3845bb72-027e-4d34-ab33-cb00b6f5a936 service nova] Creating event network-vif-plugged:a5a85d6b-1c98-44e7-b9ae-055f24d881a9 for instance 401cad35-961b-4abf-a04c-796236ed5124 on hv-cinder-84599 Jun 16 00:29:06.763221 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-cc153c43-e425-4cba-a894-5bd311203e83 req-3845bb72-027e-4d34-ab33-cb00b6f5a936 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047306 Jun 16 00:29:06.765539 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 108/211] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:29:06.855835 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-464bad13-56e2-4a1b-9b10-3db1838a590b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:06.856910 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-464bad13-56e2-4a1b-9b10-3db1838a590b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:06.872566 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-464bad13-56e2-4a1b-9b10-3db1838a590b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:06.876318 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-464bad13-56e2-4a1b-9b10-3db1838a590b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:06.879511 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-464bad13-56e2-4a1b-9b10-3db1838a590b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:06.881479 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-464bad13-56e2-4a1b-9b10-3db1838a590b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:06.937806 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:06.939862 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-9cb5ac98-6243-41a1-b7e1-e6ce4bc44127 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:06.955807 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-9cb5ac98-6243-41a1-b7e1-e6ce4bc44127 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:06.967136 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-9cb5ac98-6243-41a1-b7e1-e6ce4bc44127 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:06.970066 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-9cb5ac98-6243-41a1-b7e1-e6ce4bc44127 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1724 microversion: 2.20 time: 0.485512 Jun 16 00:29:06.971119 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 104/212] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:06 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1724 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:07.091346 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-464bad13-56e2-4a1b-9b10-3db1838a590b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:07.101224 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-464bad13-56e2-4a1b-9b10-3db1838a590b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124" status: 200 len: 1365 microversion: 2.1 time: 0.251842 Jun 16 00:29:07.101948 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 109/213] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:06 2022] GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124 => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:07.288589 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d054731f-74d6-47e4-9e2c-327540b6aa95 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:07.289326 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d054731f-74d6-47e4-9e2c-327540b6aa95 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:07.298271 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d054731f-74d6-47e4-9e2c-327540b6aa95 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:07.299222 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d054731f-74d6-47e4-9e2c-327540b6aa95 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:07.301878 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d054731f-74d6-47e4-9e2c-327540b6aa95 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:07.305992 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d054731f-74d6-47e4-9e2c-327540b6aa95 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:07.514006 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-298e7e5d-4198-4679-b346-faa387f6357e req-9b3cc864-1d2b-4a68-92c6-cfd22bdc1a15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f646dde-c456-4155-b320-b7c064ce7a0a", "tag": "feb863ac-07e7-46a6-b1d2-ad7d51aae6d4"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:29:07.526240 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-298e7e5d-4198-4679-b346-faa387f6357e req-9b3cc864-1d2b-4a68-92c6-cfd22bdc1a15 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:07.529490 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-298e7e5d-4198-4679-b346-faa387f6357e req-9b3cc864-1d2b-4a68-92c6-cfd22bdc1a15 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:07.544036 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-298e7e5d-4198-4679-b346-faa387f6357e req-9b3cc864-1d2b-4a68-92c6-cfd22bdc1a15 service nova] Creating event network-changed:feb863ac-07e7-46a6-b1d2-ad7d51aae6d4 for instance 9f646dde-c456-4155-b320-b7c064ce7a0a on hv-cinder-84599 Jun 16 00:29:07.549137 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-298e7e5d-4198-4679-b346-faa387f6357e req-9b3cc864-1d2b-4a68-92c6-cfd22bdc1a15 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039187 Jun 16 00:29:07.550164 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 110/214] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:29:07.649046 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-ae221d2f-0e19-4d49-8a35-bbb366a1b336 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:07.649936 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-ae221d2f-0e19-4d49-8a35-bbb366a1b336 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:07.656779 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ae221d2f-0e19-4d49-8a35-bbb366a1b336 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:07.657335 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ae221d2f-0e19-4d49-8a35-bbb366a1b336 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:07.658331 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ae221d2f-0e19-4d49-8a35-bbb366a1b336 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:07.658825 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ae221d2f-0e19-4d49-8a35-bbb366a1b336 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:07.697074 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d054731f-74d6-47e4-9e2c-327540b6aa95 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:07.705019 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d054731f-74d6-47e4-9e2c-327540b6aa95 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1314 microversion: 2.1 time: 0.421687 Jun 16 00:29:07.705891 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 105/215] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:07 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:07.803721 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-ae221d2f-0e19-4d49-8a35-bbb366a1b336 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:07.813175 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-ae221d2f-0e19-4d49-8a35-bbb366a1b336 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.169721 Jun 16 00:29:07.813675 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 111/216] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:07 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:07.989020 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d0429279-f983-4db4-a1e2-ed4355a2b99b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:07.989643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d0429279-f983-4db4-a1e2-ed4355a2b99b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:07.997387 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d0429279-f983-4db4-a1e2-ed4355a2b99b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:07.997826 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d0429279-f983-4db4-a1e2-ed4355a2b99b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:07.998573 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d0429279-f983-4db4-a1e2-ed4355a2b99b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:07.999093 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d0429279-f983-4db4-a1e2-ed4355a2b99b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:08.119563 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-e6cf4d90-78e7-4c48-b947-6d24dc9c32f6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:08.120407 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-e6cf4d90-78e7-4c48-b947-6d24dc9c32f6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:08.127961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e6cf4d90-78e7-4c48-b947-6d24dc9c32f6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:08.128588 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e6cf4d90-78e7-4c48-b947-6d24dc9c32f6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:08.129428 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e6cf4d90-78e7-4c48-b947-6d24dc9c32f6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:08.129796 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e6cf4d90-78e7-4c48-b947-6d24dc9c32f6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:08.249495 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d0429279-f983-4db4-a1e2-ed4355a2b99b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:08.261718 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d0429279-f983-4db4-a1e2-ed4355a2b99b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:08.266982 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d0429279-f983-4db4-a1e2-ed4355a2b99b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:08.268490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d0429279-f983-4db4-a1e2-ed4355a2b99b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1724 microversion: 2.20 time: 0.283535 Jun 16 00:29:08.271929 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 106/217] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:07 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:08.471591 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-e6cf4d90-78e7-4c48-b947-6d24dc9c32f6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:08.480073 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-e6cf4d90-78e7-4c48-b947-6d24dc9c32f6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124" status: 200 len: 1365 microversion: 2.1 time: 0.365278 Jun 16 00:29:08.490381 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 112/218] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:08 2022] GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124 => generated 1365 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:08.722252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-52e63d54-7d42-48ab-bdb3-3bf65cbd3c10 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:08.722994 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-52e63d54-7d42-48ab-bdb3-3bf65cbd3c10 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:08.729823 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-52e63d54-7d42-48ab-bdb3-3bf65cbd3c10 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:08.731086 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-52e63d54-7d42-48ab-bdb3-3bf65cbd3c10 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:08.732634 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-52e63d54-7d42-48ab-bdb3-3bf65cbd3c10 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:08.733152 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-52e63d54-7d42-48ab-bdb3-3bf65cbd3c10 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:08.831319 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-8afedc01-d85a-407f-a800-e2571eec3111 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:08.832675 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-8afedc01-d85a-407f-a800-e2571eec3111 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:08.842724 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8afedc01-d85a-407f-a800-e2571eec3111 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:08.843379 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8afedc01-d85a-407f-a800-e2571eec3111 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:08.847883 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8afedc01-d85a-407f-a800-e2571eec3111 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:08.848530 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8afedc01-d85a-407f-a800-e2571eec3111 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:08.937544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-52e63d54-7d42-48ab-bdb3-3bf65cbd3c10 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:08.949308 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-52e63d54-7d42-48ab-bdb3-3bf65cbd3c10 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1314 microversion: 2.1 time: 0.231216 Jun 16 00:29:08.959489 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 107/219] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:08 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:09.025029 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-8afedc01-d85a-407f-a800-e2571eec3111 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:09.039015 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-8afedc01-d85a-407f-a800-e2571eec3111 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.211501 Jun 16 00:29:09.039688 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 113/220] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:08 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:09.291697 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5bd0afb2-5894-45e7-a97a-86da72c9a303 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:09.292302 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-5bd0afb2-5894-45e7-a97a-86da72c9a303 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:09.298738 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5bd0afb2-5894-45e7-a97a-86da72c9a303 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:09.299179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5bd0afb2-5894-45e7-a97a-86da72c9a303 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:09.299930 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5bd0afb2-5894-45e7-a97a-86da72c9a303 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:09.300359 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5bd0afb2-5894-45e7-a97a-86da72c9a303 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:09.432365 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-5bd0afb2-5894-45e7-a97a-86da72c9a303 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:09.440377 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-5bd0afb2-5894-45e7-a97a-86da72c9a303 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:09.441891 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-5bd0afb2-5894-45e7-a97a-86da72c9a303 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:09.443112 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-5bd0afb2-5894-45e7-a97a-86da72c9a303 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1724 microversion: 2.20 time: 0.155222 Jun 16 00:29:09.443665 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 108/221] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:09 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:09.499463 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-045dd973-fbc0-48f3-9832-d1935d9481f3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:09.500297 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-045dd973-fbc0-48f3-9832-d1935d9481f3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:09.508984 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-045dd973-fbc0-48f3-9832-d1935d9481f3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:09.509648 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-045dd973-fbc0-48f3-9832-d1935d9481f3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:09.510420 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-045dd973-fbc0-48f3-9832-d1935d9481f3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:09.511002 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-045dd973-fbc0-48f3-9832-d1935d9481f3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:09.674851 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-045dd973-fbc0-48f3-9832-d1935d9481f3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:09.685186 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-045dd973-fbc0-48f3-9832-d1935d9481f3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124" status: 200 len: 1554 microversion: 2.1 time: 0.191667 Jun 16 00:29:09.686135 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 114/222] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:09 2022] GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124 => generated 1554 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:09.703809 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-902ac571-6711-4768-837d-4186e59a9ca8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:09.704488 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-902ac571-6711-4768-837d-4186e59a9ca8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:09.711945 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-902ac571-6711-4768-837d-4186e59a9ca8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:09.712506 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-902ac571-6711-4768-837d-4186e59a9ca8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:09.713397 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-902ac571-6711-4768-837d-4186e59a9ca8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:09.713903 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-902ac571-6711-4768-837d-4186e59a9ca8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:09.798514 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-902ac571-6711-4768-837d-4186e59a9ca8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098557 Jun 16 00:29:09.799172 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 109/223] 10.222.0.23 () {58 vars in 1274 bytes} [Thu Jun 16 00:29:09 2022] GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:29:09.966914 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-a00a96f6-b1f6-48c3-abc5-bfcaf8482359 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:09.967618 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-a00a96f6-b1f6-48c3-abc5-bfcaf8482359 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:09.973833 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a00a96f6-b1f6-48c3-abc5-bfcaf8482359 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:09.975056 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a00a96f6-b1f6-48c3-abc5-bfcaf8482359 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:09.976044 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a00a96f6-b1f6-48c3-abc5-bfcaf8482359 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:09.976344 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a00a96f6-b1f6-48c3-abc5-bfcaf8482359 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:10.057971 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-bff23236-5455-4374-8fb2-2305445573e2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:10.059237 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-bff23236-5455-4374-8fb2-2305445573e2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:10.067225 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bff23236-5455-4374-8fb2-2305445573e2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:10.068124 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bff23236-5455-4374-8fb2-2305445573e2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:10.069979 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bff23236-5455-4374-8fb2-2305445573e2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:10.070955 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bff23236-5455-4374-8fb2-2305445573e2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:10.133242 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-a00a96f6-b1f6-48c3-abc5-bfcaf8482359 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:10.142625 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-a00a96f6-b1f6-48c3-abc5-bfcaf8482359 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1314 microversion: 2.1 time: 0.179777 Jun 16 00:29:10.143612 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 115/224] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:09 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:10.444142 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-bff23236-5455-4374-8fb2-2305445573e2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:10.459651 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-bff23236-5455-4374-8fb2-2305445573e2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.407405 Jun 16 00:29:10.460665 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 110/225] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:10 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:10.463217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d938af9f-7c08-4bce-9ac2-c6bf20ddd2e2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:10.465711 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-d938af9f-7c08-4bce-9ac2-c6bf20ddd2e2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:10.471997 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d938af9f-7c08-4bce-9ac2-c6bf20ddd2e2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:10.472447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d938af9f-7c08-4bce-9ac2-c6bf20ddd2e2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:10.473273 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d938af9f-7c08-4bce-9ac2-c6bf20ddd2e2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:10.473750 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d938af9f-7c08-4bce-9ac2-c6bf20ddd2e2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:10.617308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d938af9f-7c08-4bce-9ac2-c6bf20ddd2e2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:10.625168 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d938af9f-7c08-4bce-9ac2-c6bf20ddd2e2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:10.626649 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d938af9f-7c08-4bce-9ac2-c6bf20ddd2e2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:10.627810 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-d938af9f-7c08-4bce-9ac2-c6bf20ddd2e2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1724 microversion: 2.20 time: 0.170077 Jun 16 00:29:10.628354 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 116/226] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:10 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:11.171031 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-a764897c-6dbf-47c7-8899-084b11bca1f6 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:11.171912 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-a764897c-6dbf-47c7-8899-084b11bca1f6 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:11.178852 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a764897c-6dbf-47c7-8899-084b11bca1f6 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:11.179530 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a764897c-6dbf-47c7-8899-084b11bca1f6 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:11.180482 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a764897c-6dbf-47c7-8899-084b11bca1f6 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:11.181114 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a764897c-6dbf-47c7-8899-084b11bca1f6 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:11.369149 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a764897c-6dbf-47c7-8899-084b11bca1f6 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:11.372611 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:11.381984 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-a764897c-6dbf-47c7-8899-084b11bca1f6 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1314 microversion: 2.1 time: 0.223701 Jun 16 00:29:11.382692 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 111/227] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:11 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:11.480211 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-56836d0f-82aa-4b19-a986-8843a20144f7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:11.480824 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-56836d0f-82aa-4b19-a986-8843a20144f7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:11.487170 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-56836d0f-82aa-4b19-a986-8843a20144f7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:11.487621 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-56836d0f-82aa-4b19-a986-8843a20144f7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:11.488394 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-56836d0f-82aa-4b19-a986-8843a20144f7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:11.488828 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-56836d0f-82aa-4b19-a986-8843a20144f7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:11.579687 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-937759f8-01c9-48e1-b122-94602ffe74cd req-4e41e35e-81f4-4f59-9ffd-b5af9d547126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "401cad35-961b-4abf-a04c-796236ed5124", "tag": "a5a85d6b-1c98-44e7-b9ae-055f24d881a9"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:29:11.597540 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-937759f8-01c9-48e1-b122-94602ffe74cd req-4e41e35e-81f4-4f59-9ffd-b5af9d547126 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:11.597996 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-937759f8-01c9-48e1-b122-94602ffe74cd req-4e41e35e-81f4-4f59-9ffd-b5af9d547126 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:11.624378 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-937759f8-01c9-48e1-b122-94602ffe74cd req-4e41e35e-81f4-4f59-9ffd-b5af9d547126 service nova] Creating event network-changed:a5a85d6b-1c98-44e7-b9ae-055f24d881a9 for instance 401cad35-961b-4abf-a04c-796236ed5124 on hv-cinder-84599 Jun 16 00:29:11.633369 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-937759f8-01c9-48e1-b122-94602ffe74cd req-4e41e35e-81f4-4f59-9ffd-b5af9d547126 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057552 Jun 16 00:29:11.634425 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 112/228] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:29:11.660070 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-65968040-c78c-41fc-9913-bcc9ab1ca4ca tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:11.661437 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-65968040-c78c-41fc-9913-bcc9ab1ca4ca tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:11.670568 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-65968040-c78c-41fc-9913-bcc9ab1ca4ca tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:11.671174 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-65968040-c78c-41fc-9913-bcc9ab1ca4ca tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:11.673219 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-65968040-c78c-41fc-9913-bcc9ab1ca4ca tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:11.673661 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-65968040-c78c-41fc-9913-bcc9ab1ca4ca tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:11.750195 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-56836d0f-82aa-4b19-a986-8843a20144f7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:11.765232 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-56836d0f-82aa-4b19-a986-8843a20144f7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.292026 Jun 16 00:29:11.769027 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 117/229] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:11 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:12.031087 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-65968040-c78c-41fc-9913-bcc9ab1ca4ca tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:12.049146 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-65968040-c78c-41fc-9913-bcc9ab1ca4ca tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:12.050654 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-65968040-c78c-41fc-9913-bcc9ab1ca4ca tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:12.051827 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-65968040-c78c-41fc-9913-bcc9ab1ca4ca tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1724 microversion: 2.20 time: 0.407352 Jun 16 00:29:12.052381 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 113/230] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:11 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1724 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:29:12.401037 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-067a0514-a3f0-4795-8238-48fdd0c8407a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:12.402739 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-067a0514-a3f0-4795-8238-48fdd0c8407a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:12.415698 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-067a0514-a3f0-4795-8238-48fdd0c8407a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:12.417744 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-067a0514-a3f0-4795-8238-48fdd0c8407a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:12.422940 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-067a0514-a3f0-4795-8238-48fdd0c8407a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:12.423884 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-067a0514-a3f0-4795-8238-48fdd0c8407a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:12.706578 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-067a0514-a3f0-4795-8238-48fdd0c8407a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:12.723684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-067a0514-a3f0-4795-8238-48fdd0c8407a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1314 microversion: 2.1 time: 0.326190 Jun 16 00:29:12.724593 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 118/231] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:12 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:12.789483 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d82f82af-e888-4d4d-b5e7-ea1603e91b46 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:12.790312 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d82f82af-e888-4d4d-b5e7-ea1603e91b46 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:12.802382 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d82f82af-e888-4d4d-b5e7-ea1603e91b46 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:12.802889 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d82f82af-e888-4d4d-b5e7-ea1603e91b46 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:12.807301 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d82f82af-e888-4d4d-b5e7-ea1603e91b46 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:12.811257 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d82f82af-e888-4d4d-b5e7-ea1603e91b46 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:13.071665 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-a18a3444-8007-4a61-91dc-1c9b1e46359d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:13.072406 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-a18a3444-8007-4a61-91dc-1c9b1e46359d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:13.088435 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:13.090080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a18a3444-8007-4a61-91dc-1c9b1e46359d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:13.090502 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a18a3444-8007-4a61-91dc-1c9b1e46359d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:13.091458 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a18a3444-8007-4a61-91dc-1c9b1e46359d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:13.091878 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a18a3444-8007-4a61-91dc-1c9b1e46359d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:13.161396 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d82f82af-e888-4d4d-b5e7-ea1603e91b46 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:13.173120 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d82f82af-e888-4d4d-b5e7-ea1603e91b46 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.388893 Jun 16 00:29:13.174255 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 114/232] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:12 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:13.276189 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-a18a3444-8007-4a61-91dc-1c9b1e46359d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:13.284793 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-a18a3444-8007-4a61-91dc-1c9b1e46359d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:13.286319 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-a18a3444-8007-4a61-91dc-1c9b1e46359d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:13.287545 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-a18a3444-8007-4a61-91dc-1c9b1e46359d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1724 microversion: 2.20 time: 0.221147 Jun 16 00:29:13.301137 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 119/233] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:13 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:13.746219 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-fe891c7b-2630-4c8c-83c4-98a2723d4bf7 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:13.747636 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-fe891c7b-2630-4c8c-83c4-98a2723d4bf7 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:13.751080 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=4 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:13.753916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=14 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:13.764465 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fe891c7b-2630-4c8c-83c4-98a2723d4bf7 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:13.765346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fe891c7b-2630-4c8c-83c4-98a2723d4bf7 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:13.779704 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fe891c7b-2630-4c8c-83c4-98a2723d4bf7 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:13.780103 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fe891c7b-2630-4c8c-83c4-98a2723d4bf7 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:14.138538 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-fe891c7b-2630-4c8c-83c4-98a2723d4bf7 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:14.148580 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-fe891c7b-2630-4c8c-83c4-98a2723d4bf7 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1314 microversion: 2.1 time: 0.409105 Jun 16 00:29:14.149287 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 115/234] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:13 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:14.196146 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-98d67518-10cb-4934-96b2-f67608aad00f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:14.196839 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-98d67518-10cb-4934-96b2-f67608aad00f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:14.206657 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-98d67518-10cb-4934-96b2-f67608aad00f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:14.207105 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-98d67518-10cb-4934-96b2-f67608aad00f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:14.207875 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-98d67518-10cb-4934-96b2-f67608aad00f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:14.208306 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-98d67518-10cb-4934-96b2-f67608aad00f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:14.316103 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b782373d-90f2-4ef9-9574-dc33eb041ba1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:14.316895 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-b782373d-90f2-4ef9-9574-dc33eb041ba1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:14.322270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:14.343573 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b782373d-90f2-4ef9-9574-dc33eb041ba1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:14.345018 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b782373d-90f2-4ef9-9574-dc33eb041ba1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:14.345018 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b782373d-90f2-4ef9-9574-dc33eb041ba1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:14.345473 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b782373d-90f2-4ef9-9574-dc33eb041ba1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:14.428785 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-98d67518-10cb-4934-96b2-f67608aad00f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:14.446101 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-98d67518-10cb-4934-96b2-f67608aad00f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.255422 Jun 16 00:29:14.448792 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 120/235] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:14 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:14.585144 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-752bf685-af13-44a7-9b31-385ed38c26db req-c05bf4d8-7eaf-4665-9b62-d86622fc24da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f646dde-c456-4155-b320-b7c064ce7a0a", "name": "network-vif-plugged", "status": "completed", "tag": "feb863ac-07e7-46a6-b1d2-ad7d51aae6d4"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:29:14.596859 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-752bf685-af13-44a7-9b31-385ed38c26db req-c05bf4d8-7eaf-4665-9b62-d86622fc24da service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:14.597907 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-752bf685-af13-44a7-9b31-385ed38c26db req-c05bf4d8-7eaf-4665-9b62-d86622fc24da service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:14.632739 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-752bf685-af13-44a7-9b31-385ed38c26db req-c05bf4d8-7eaf-4665-9b62-d86622fc24da service nova] Creating event network-vif-plugged:feb863ac-07e7-46a6-b1d2-ad7d51aae6d4 for instance 9f646dde-c456-4155-b320-b7c064ce7a0a on hv-cinder-84599 Jun 16 00:29:14.648674 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-752bf685-af13-44a7-9b31-385ed38c26db req-c05bf4d8-7eaf-4665-9b62-d86622fc24da service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068012 Jun 16 00:29:14.648864 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b782373d-90f2-4ef9-9574-dc33eb041ba1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:14.649794 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 121/236] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:29:14.657745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b782373d-90f2-4ef9-9574-dc33eb041ba1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:14.659311 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b782373d-90f2-4ef9-9574-dc33eb041ba1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:14.660629 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-b782373d-90f2-4ef9-9574-dc33eb041ba1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1724 microversion: 2.20 time: 0.351469 Jun 16 00:29:14.662178 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 116/237] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:14 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1724 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:29:15.166062 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-60aadf6b-2569-4313-b253-7ee906d2e2e9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:15.166754 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-60aadf6b-2569-4313-b253-7ee906d2e2e9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:15.172847 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-60aadf6b-2569-4313-b253-7ee906d2e2e9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:15.173316 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-60aadf6b-2569-4313-b253-7ee906d2e2e9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:15.174060 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-60aadf6b-2569-4313-b253-7ee906d2e2e9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:15.174482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-60aadf6b-2569-4313-b253-7ee906d2e2e9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:15.310906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-60aadf6b-2569-4313-b253-7ee906d2e2e9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:15.319035 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-60aadf6b-2569-4313-b253-7ee906d2e2e9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1314 microversion: 2.1 time: 0.157183 Jun 16 00:29:15.319605 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 122/238] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:15 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:15.466072 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d064a5e9-52b3-4ed3-b597-7b906ab7d2fd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:15.467050 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d064a5e9-52b3-4ed3-b597-7b906ab7d2fd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:15.474208 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d064a5e9-52b3-4ed3-b597-7b906ab7d2fd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:15.475411 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d064a5e9-52b3-4ed3-b597-7b906ab7d2fd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:15.476257 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d064a5e9-52b3-4ed3-b597-7b906ab7d2fd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:15.476764 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d064a5e9-52b3-4ed3-b597-7b906ab7d2fd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:15.629425 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d064a5e9-52b3-4ed3-b597-7b906ab7d2fd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:15.637078 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d064a5e9-52b3-4ed3-b597-7b906ab7d2fd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.175728 Jun 16 00:29:15.637643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 117/239] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:15 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:15.681017 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-443fe224-e5c1-421b-acb0-4740a23fc7cd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:15.681690 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-443fe224-e5c1-421b-acb0-4740a23fc7cd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:15.688088 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-443fe224-e5c1-421b-acb0-4740a23fc7cd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:15.688599 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-443fe224-e5c1-421b-acb0-4740a23fc7cd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:15.689547 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-443fe224-e5c1-421b-acb0-4740a23fc7cd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:15.690056 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-443fe224-e5c1-421b-acb0-4740a23fc7cd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:15.827074 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-443fe224-e5c1-421b-acb0-4740a23fc7cd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:15.835796 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-443fe224-e5c1-421b-acb0-4740a23fc7cd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:15.837316 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-443fe224-e5c1-421b-acb0-4740a23fc7cd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:15.838465 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-443fe224-e5c1-421b-acb0-4740a23fc7cd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1724 microversion: 2.20 time: 0.162549 Jun 16 00:29:15.839018 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 123/240] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:15 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:29:16.338172 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-4ac680d1-f518-42f2-8ec7-120f1e0aa64a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:16.339077 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-4ac680d1-f518-42f2-8ec7-120f1e0aa64a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:16.345797 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4ac680d1-f518-42f2-8ec7-120f1e0aa64a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:16.346425 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4ac680d1-f518-42f2-8ec7-120f1e0aa64a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:16.347435 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4ac680d1-f518-42f2-8ec7-120f1e0aa64a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:16.348109 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4ac680d1-f518-42f2-8ec7-120f1e0aa64a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:16.486194 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-4ac680d1-f518-42f2-8ec7-120f1e0aa64a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:16.494362 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-4ac680d1-f518-42f2-8ec7-120f1e0aa64a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1314 microversion: 2.1 time: 0.161838 Jun 16 00:29:16.503393 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 118/241] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:16 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:16.655994 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-608228ee-78a2-4848-809e-04106efd57e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:16.656699 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-608228ee-78a2-4848-809e-04106efd57e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:16.663891 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-608228ee-78a2-4848-809e-04106efd57e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:16.664341 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-608228ee-78a2-4848-809e-04106efd57e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:16.665132 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-608228ee-78a2-4848-809e-04106efd57e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:16.665565 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-608228ee-78a2-4848-809e-04106efd57e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:16.798629 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-608228ee-78a2-4848-809e-04106efd57e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:16.806070 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-608228ee-78a2-4848-809e-04106efd57e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.154157 Jun 16 00:29:16.806617 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 124/242] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:16 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:16.856408 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-93a81177-8fee-47d6-97a7-cc92026892f5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:16.857032 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-93a81177-8fee-47d6-97a7-cc92026892f5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:16.863036 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-93a81177-8fee-47d6-97a7-cc92026892f5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:16.863418 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-93a81177-8fee-47d6-97a7-cc92026892f5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:16.864162 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-93a81177-8fee-47d6-97a7-cc92026892f5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:16.864590 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-93a81177-8fee-47d6-97a7-cc92026892f5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:16.990859 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-93a81177-8fee-47d6-97a7-cc92026892f5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:16.998660 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-93a81177-8fee-47d6-97a7-cc92026892f5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:17.000151 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-93a81177-8fee-47d6-97a7-cc92026892f5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:17.001318 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-93a81177-8fee-47d6-97a7-cc92026892f5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1724 microversion: 2.20 time: 0.148790 Jun 16 00:29:17.001871 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 119/243] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:16 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:17.512075 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d64bee81-15a8-4756-8b47-22458d701cbb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:17.512671 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-d64bee81-15a8-4756-8b47-22458d701cbb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:17.519076 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d64bee81-15a8-4756-8b47-22458d701cbb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:17.519526 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d64bee81-15a8-4756-8b47-22458d701cbb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:17.520916 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d64bee81-15a8-4756-8b47-22458d701cbb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:17.521354 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d64bee81-15a8-4756-8b47-22458d701cbb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:17.685959 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d64bee81-15a8-4756-8b47-22458d701cbb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:17.693604 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-d64bee81-15a8-4756-8b47-22458d701cbb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1314 microversion: 2.1 time: 0.186300 Jun 16 00:29:17.694158 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 125/244] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:17 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:17.823267 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-3c4ebd9f-ffa9-4957-917e-6727621a2792 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:17.823871 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-3c4ebd9f-ffa9-4957-917e-6727621a2792 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:17.830460 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3c4ebd9f-ffa9-4957-917e-6727621a2792 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:17.830943 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3c4ebd9f-ffa9-4957-917e-6727621a2792 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:17.831706 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3c4ebd9f-ffa9-4957-917e-6727621a2792 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:17.832140 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3c4ebd9f-ffa9-4957-917e-6727621a2792 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:17.993795 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-3c4ebd9f-ffa9-4957-917e-6727621a2792 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:18.001242 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-3c4ebd9f-ffa9-4957-917e-6727621a2792 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.181793 Jun 16 00:29:18.001807 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 120/245] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:17 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:18.020144 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-782a38c3-b0fa-4de6-81b5-d0b5f4c380d9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:18.020747 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-782a38c3-b0fa-4de6-81b5-d0b5f4c380d9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:18.027718 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-782a38c3-b0fa-4de6-81b5-d0b5f4c380d9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:18.028182 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-782a38c3-b0fa-4de6-81b5-d0b5f4c380d9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:18.028955 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-782a38c3-b0fa-4de6-81b5-d0b5f4c380d9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:18.029407 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-782a38c3-b0fa-4de6-81b5-d0b5f4c380d9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:18.165004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-782a38c3-b0fa-4de6-81b5-d0b5f4c380d9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:18.172987 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-782a38c3-b0fa-4de6-81b5-d0b5f4c380d9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:18.174479 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-782a38c3-b0fa-4de6-81b5-d0b5f4c380d9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:18.175626 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-782a38c3-b0fa-4de6-81b5-d0b5f4c380d9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1724 microversion: 2.20 time: 0.159309 Jun 16 00:29:18.176190 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 126/246] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:18 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:18.714180 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-6aea082f-8cb6-46fa-bb65-7be75517b32c tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:18.714783 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-6aea082f-8cb6-46fa-bb65-7be75517b32c tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:18.720756 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6aea082f-8cb6-46fa-bb65-7be75517b32c tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:18.721235 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6aea082f-8cb6-46fa-bb65-7be75517b32c tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:18.727794 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6aea082f-8cb6-46fa-bb65-7be75517b32c tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:18.728240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6aea082f-8cb6-46fa-bb65-7be75517b32c tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:18.871766 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-6aea082f-8cb6-46fa-bb65-7be75517b32c tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:18.882404 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-6aea082f-8cb6-46fa-bb65-7be75517b32c tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1314 microversion: 2.1 time: 0.171765 Jun 16 00:29:18.883064 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 121/247] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:18 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:19.019052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-2e081944-e033-4ed9-aff0-01c72b25aa12 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:19.019963 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-2e081944-e033-4ed9-aff0-01c72b25aa12 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:19.027277 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2e081944-e033-4ed9-aff0-01c72b25aa12 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:19.027871 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2e081944-e033-4ed9-aff0-01c72b25aa12 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:19.028951 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2e081944-e033-4ed9-aff0-01c72b25aa12 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:19.029494 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2e081944-e033-4ed9-aff0-01c72b25aa12 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:19.054212 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=100 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:19.183818 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-2e081944-e033-4ed9-aff0-01c72b25aa12 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:19.194304 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-25b489dc-a491-40c1-b575-dabcb871265f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:19.194911 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-25b489dc-a491-40c1-b575-dabcb871265f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:19.195319 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-2e081944-e033-4ed9-aff0-01c72b25aa12 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.179716 Jun 16 00:29:19.201579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-25b489dc-a491-40c1-b575-dabcb871265f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:19.202289 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-25b489dc-a491-40c1-b575-dabcb871265f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:19.203324 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-25b489dc-a491-40c1-b575-dabcb871265f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:19.204011 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-25b489dc-a491-40c1-b575-dabcb871265f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:19.205638 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 127/248] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:19 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:19.367691 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-25b489dc-a491-40c1-b575-dabcb871265f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:19.376808 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-25b489dc-a491-40c1-b575-dabcb871265f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:19.378342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-25b489dc-a491-40c1-b575-dabcb871265f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:19.379539 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-25b489dc-a491-40c1-b575-dabcb871265f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1724 microversion: 2.20 time: 0.189668 Jun 16 00:29:19.390148 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 122/249] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:19 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:19.899845 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-85c8798d-1e07-4ec2-b60d-8cc4fcad1060 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:19.900832 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-85c8798d-1e07-4ec2-b60d-8cc4fcad1060 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:19.909735 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-85c8798d-1e07-4ec2-b60d-8cc4fcad1060 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:19.909735 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-85c8798d-1e07-4ec2-b60d-8cc4fcad1060 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:19.909735 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-85c8798d-1e07-4ec2-b60d-8cc4fcad1060 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:19.909972 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-85c8798d-1e07-4ec2-b60d-8cc4fcad1060 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:20.108034 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-85c8798d-1e07-4ec2-b60d-8cc4fcad1060 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:20.116751 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-85c8798d-1e07-4ec2-b60d-8cc4fcad1060 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1314 microversion: 2.1 time: 0.221218 Jun 16 00:29:20.117372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 128/250] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:19 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:20.212640 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-ba018ba3-fedd-4ef5-a3d7-9d06f3a3d30c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:20.213869 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-ba018ba3-fedd-4ef5-a3d7-9d06f3a3d30c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:20.220377 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ba018ba3-fedd-4ef5-a3d7-9d06f3a3d30c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:20.220825 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ba018ba3-fedd-4ef5-a3d7-9d06f3a3d30c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:20.221630 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ba018ba3-fedd-4ef5-a3d7-9d06f3a3d30c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:20.222119 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ba018ba3-fedd-4ef5-a3d7-9d06f3a3d30c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:20.363751 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-ba018ba3-fedd-4ef5-a3d7-9d06f3a3d30c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:20.372312 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-ba018ba3-fedd-4ef5-a3d7-9d06f3a3d30c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.164762 Jun 16 00:29:20.373396 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 123/251] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:20 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:20.398787 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-90f43871-1a80-4962-b474-6d6676ad9431 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:20.399394 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-90f43871-1a80-4962-b474-6d6676ad9431 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:20.406096 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-90f43871-1a80-4962-b474-6d6676ad9431 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:20.406597 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-90f43871-1a80-4962-b474-6d6676ad9431 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:20.407337 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-90f43871-1a80-4962-b474-6d6676ad9431 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:20.407944 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-90f43871-1a80-4962-b474-6d6676ad9431 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:20.566408 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-90f43871-1a80-4962-b474-6d6676ad9431 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:20.582181 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-90f43871-1a80-4962-b474-6d6676ad9431 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:20.585216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-90f43871-1a80-4962-b474-6d6676ad9431 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:20.586916 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-90f43871-1a80-4962-b474-6d6676ad9431 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1724 microversion: 2.20 time: 0.192922 Jun 16 00:29:20.587752 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 129/252] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:20 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:21.134264 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-a0163724-9467-4951-b28c-7bd45907012f tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:21.135054 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-a0163724-9467-4951-b28c-7bd45907012f tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:21.142378 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a0163724-9467-4951-b28c-7bd45907012f tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:21.142824 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a0163724-9467-4951-b28c-7bd45907012f tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:21.143586 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a0163724-9467-4951-b28c-7bd45907012f tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:21.144028 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a0163724-9467-4951-b28c-7bd45907012f tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:21.289584 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a0163724-9467-4951-b28c-7bd45907012f tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:21.297549 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-a0163724-9467-4951-b28c-7bd45907012f tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1498 microversion: 2.1 time: 0.168293 Jun 16 00:29:21.298110 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 124/253] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:21 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1498 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:21.389927 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-6a2222df-d2fb-45ad-b6f5-9c4a249fd7a6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:21.390521 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-6a2222df-d2fb-45ad-b6f5-9c4a249fd7a6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:21.398139 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6a2222df-d2fb-45ad-b6f5-9c4a249fd7a6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:21.398803 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6a2222df-d2fb-45ad-b6f5-9c4a249fd7a6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:21.399612 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6a2222df-d2fb-45ad-b6f5-9c4a249fd7a6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:21.400038 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6a2222df-d2fb-45ad-b6f5-9c4a249fd7a6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:21.527116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-6a2222df-d2fb-45ad-b6f5-9c4a249fd7a6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:21.534982 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-6a2222df-d2fb-45ad-b6f5-9c4a249fd7a6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.148877 Jun 16 00:29:21.535549 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 130/254] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:21 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:21.606884 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-0ebfc2db-fdc6-403e-85d2-edd25416b528 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:21.607523 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-0ebfc2db-fdc6-403e-85d2-edd25416b528 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:21.613646 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0ebfc2db-fdc6-403e-85d2-edd25416b528 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:21.614093 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0ebfc2db-fdc6-403e-85d2-edd25416b528 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:21.615702 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0ebfc2db-fdc6-403e-85d2-edd25416b528 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:21.616121 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0ebfc2db-fdc6-403e-85d2-edd25416b528 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:21.763358 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0ebfc2db-fdc6-403e-85d2-edd25416b528 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:21.773624 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0ebfc2db-fdc6-403e-85d2-edd25416b528 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:21.775369 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0ebfc2db-fdc6-403e-85d2-edd25416b528 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:21.776794 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-0ebfc2db-fdc6-403e-85d2-edd25416b528 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1724 microversion: 2.20 time: 0.173761 Jun 16 00:29:21.777550 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 125/255] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:21 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:22.065984 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-cd0b7a82-a4b6-411a-b6df-17a84e5b1e75 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:22.066477 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-cd0b7a82-a4b6-411a-b6df-17a84e5b1e75 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:22.073056 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cd0b7a82-a4b6-411a-b6df-17a84e5b1e75 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:22.073498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cd0b7a82-a4b6-411a-b6df-17a84e5b1e75 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:22.074354 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cd0b7a82-a4b6-411a-b6df-17a84e5b1e75 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:22.074778 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cd0b7a82-a4b6-411a-b6df-17a84e5b1e75 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:22.100787 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-cd0b7a82-a4b6-411a-b6df-17a84e5b1e75 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Going to try to terminate instance {{(pid=124231) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:29:22.176917 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-cd0b7a82-a4b6-411a-b6df-17a84e5b1e75 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 204 len: 0 microversion: 2.1 time: 0.114480 Jun 16 00:29:22.177544 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 131/256] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:29:22 2022] DELETE /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:29:22.186054 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-a6ce8e6b-bc98-4acc-ba65-6d84592cbdc5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:22.186738 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-a6ce8e6b-bc98-4acc-ba65-6d84592cbdc5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:22.193239 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a6ce8e6b-bc98-4acc-ba65-6d84592cbdc5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:22.193666 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a6ce8e6b-bc98-4acc-ba65-6d84592cbdc5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:22.194440 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a6ce8e6b-bc98-4acc-ba65-6d84592cbdc5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:22.194867 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a6ce8e6b-bc98-4acc-ba65-6d84592cbdc5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:22.349194 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a6ce8e6b-bc98-4acc-ba65-6d84592cbdc5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:22.358049 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-a6ce8e6b-bc98-4acc-ba65-6d84592cbdc5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1504 microversion: 2.1 time: 0.175982 Jun 16 00:29:22.358809 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 126/257] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:22 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:22.552537 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-c35e5e39-43d3-4704-be0c-b11fd37f64e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:22.553302 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-c35e5e39-43d3-4704-be0c-b11fd37f64e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:22.559748 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c35e5e39-43d3-4704-be0c-b11fd37f64e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:22.560343 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c35e5e39-43d3-4704-be0c-b11fd37f64e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:22.561316 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c35e5e39-43d3-4704-be0c-b11fd37f64e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:22.561908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c35e5e39-43d3-4704-be0c-b11fd37f64e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:22.705612 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-c35e5e39-43d3-4704-be0c-b11fd37f64e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:22.714092 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-c35e5e39-43d3-4704-be0c-b11fd37f64e0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1501 microversion: 2.1 time: 0.165922 Jun 16 00:29:22.714537 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 132/258] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:22 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1501 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:22.731704 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-da5e0ada-ddcb-4cf2-bc86-a640a42b710c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed6a880e-0b4f-4e37-ad33-792e233c29ca"}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:29:22.732841 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-da5e0ada-ddcb-4cf2-bc86-a640a42b710c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:22.740512 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-da5e0ada-ddcb-4cf2-bc86-a640a42b710c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:22.741180 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-da5e0ada-ddcb-4cf2-bc86-a640a42b710c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:22.741915 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-da5e0ada-ddcb-4cf2-bc86-a640a42b710c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:22.742355 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-da5e0ada-ddcb-4cf2-bc86-a640a42b710c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:22.766198 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-da5e0ada-ddcb-4cf2-bc86-a640a42b710c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] HTTP exception thrown: Cannot 'attach_volume' instance c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 while it is in vm_state rescued Jun 16 00:29:22.768021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-da5e0ada-ddcb-4cf2-bc86-a640a42b710c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Request method failure captured: Jun 16 00:29:22.768021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: POST /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0/os-volume_attachments HTTP/1.1 Jun 16 00:29:22.768021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:29:22.768021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:29:22.768021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:29:22.768021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 74 Jun 16 00:29:22.768021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:29:22.768021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:29:22.768021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:29:22.768021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:29:22.768021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnjluY8jZVwwXlOxm5eGZoFzFsj2WHogoL70GrXk2XOxd5Vf-PQx2JzADNPun2hb_8YyL9atzw5OxHWiHsfPkN2e7HqJqwrKwxps6tY-O3e7u5qOSEIFwcLZmY6rGSskA_q37XGnDB6px_8ba9EsdtwksBNgGyqpqYD5fPwGkZ95O9E Jun 16 00:29:22.768021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:29:22.768021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:29:22.768021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:29:22.768021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:29:22.768021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:29:22.768021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:29:22.768021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: 0e5f17f8ba8e4113a27a004ebb29917a Jun 16 00:29:22.768021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1345783981 Jun 16 00:29:22.768021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:29:22.768021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:29:22.769435 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0e5f17f8ba8e4113a27a004ebb29917a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0e5f17f8ba8e4113a27a004ebb29917a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0e5f17f8ba8e4113a27a004ebb29917a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0e5f17f8ba8e4113a27a004ebb29917a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:29:22.769435 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1345783981 Jun 16 00:29:22.769435 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: 0e5f17f8ba8e4113a27a004ebb29917a Jun 16 00:29:22.769435 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1345783981 Jun 16 00:29:22.769435 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-ServerRescueNegativeTestJSON-1345783981-project Jun 16 00:29:22.769435 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:29:22.769435 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:29:22.769435 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: b5f4125ecaec41e5ba5c4eaf00c43e07 Jun 16 00:29:22.769435 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1345783981-project Jun 16 00:29:22.769435 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Jun 16 00:29:22.769435 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {"volumeAttachment": {"volumeId": "ed6a880e-0b4f-4e37-ad33-792e233c29ca"}} Jun 16 00:29:22.769435 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: > Jun 16 00:29:22.770176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Cannot 'attach_volume' instance c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 while it is in vm_state rescued Jun 16 00:29:22.770176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'server_id': 'c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0', 'body': {'volumeAttachment': {'volumeId': 'ed6a880e-0b4f-4e37-ad33-792e233c29ca'}}} Jun 16 00:29:22.770176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:29:22.770176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:29:22.770176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 00:29:22.770176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 00:29:22.770176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 00:29:22.770176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 00:29:22.770176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 00:29:22.770176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 00:29:22.770176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 16 00:29:22.770176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:29:22.770176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:29:22.770176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:29:22.770176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:29:22.770176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:29:22.770176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:29:22.770176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:29:22.770176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:29:22.772566 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:29:22.772566 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:29:22.772566 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:29:22.772566 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:29:22.772566 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:29:22.772566 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:29:22.772566 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:29:22.772566 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:29:22.772566 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 16 00:29:22.772566 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 00:29:22.772566 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 00:29:22.772566 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 00:29:22.772566 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 while it is in vm_state rescued Jun 16 00:29:22.772566 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:29:22.772566 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:29:22.772566 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:29:22.772566 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:29:22.772566 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:29:22.772566 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:29:22.774889 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:29:22.774889 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:29:22.774889 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 while it is in vm_state rescued Jun 16 00:29:22.774889 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:29:22.774889 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-da5e0ada-ddcb-4cf2-bc86-a640a42b710c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Returning 409 to user: Cannot 'attach_volume' instance c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 while it is in vm_state rescued {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:29:22.774889 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-da5e0ada-ddcb-4cf2-bc86-a640a42b710c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "POST /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041886 Jun 16 00:29:22.774889 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 127/259] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Jun 16 00:29:22 2022] POST /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 16 00:29:22.778867 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-e7e19d91-3e4c-48a7-8bdb-83ddc8fdce76 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:29:22.779400 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-e7e19d91-3e4c-48a7-8bdb-83ddc8fdce76 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:22.785382 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e7e19d91-3e4c-48a7-8bdb-83ddc8fdce76 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:22.785850 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e7e19d91-3e4c-48a7-8bdb-83ddc8fdce76 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:22.787419 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e7e19d91-3e4c-48a7-8bdb-83ddc8fdce76 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:22.787908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e7e19d91-3e4c-48a7-8bdb-83ddc8fdce76 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:22.797025 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-584bf167-84f0-4c6d-8a03-3452fabd2e2b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:22.797634 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-584bf167-84f0-4c6d-8a03-3452fabd2e2b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:22.806272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-584bf167-84f0-4c6d-8a03-3452fabd2e2b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:22.806702 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-584bf167-84f0-4c6d-8a03-3452fabd2e2b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:22.807482 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-584bf167-84f0-4c6d-8a03-3452fabd2e2b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:22.807925 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-584bf167-84f0-4c6d-8a03-3452fabd2e2b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:22.867428 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-e7e19d91-3e4c-48a7-8bdb-83ddc8fdce76 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "POST /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0/action" status: 202 len: 0 microversion: 2.1 time: 0.092209 Jun 16 00:29:22.871171 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 133/260] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Jun 16 00:29:22 2022] POST /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:29:22.876587 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-aaa642a0-38e1-4194-a082-25b4c0dca0aa tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:22.877952 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-aaa642a0-38e1-4194-a082-25b4c0dca0aa tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:22.884510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-aaa642a0-38e1-4194-a082-25b4c0dca0aa tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:22.885023 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-aaa642a0-38e1-4194-a082-25b4c0dca0aa tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:22.885799 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-aaa642a0-38e1-4194-a082-25b4c0dca0aa tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:22.886233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-aaa642a0-38e1-4194-a082-25b4c0dca0aa tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:22.964033 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-584bf167-84f0-4c6d-8a03-3452fabd2e2b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:22.972713 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-584bf167-84f0-4c6d-8a03-3452fabd2e2b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:22.974995 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-584bf167-84f0-4c6d-8a03-3452fabd2e2b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:22.976705 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-584bf167-84f0-4c6d-8a03-3452fabd2e2b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1724 microversion: 2.20 time: 0.183542 Jun 16 00:29:22.977281 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 128/261] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:22 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:29:23.039402 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-aaa642a0-38e1-4194-a082-25b4c0dca0aa tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:23.046950 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-aaa642a0-38e1-4194-a082-25b4c0dca0aa tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1509 microversion: 2.1 time: 0.174390 Jun 16 00:29:23.047522 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 134/262] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:22 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:23.375000 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c7b1a119-c10f-4e0b-9912-d88f060ba5d8 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:23.375625 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c7b1a119-c10f-4e0b-9912-d88f060ba5d8 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:23.381780 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c7b1a119-c10f-4e0b-9912-d88f060ba5d8 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:23.382220 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c7b1a119-c10f-4e0b-9912-d88f060ba5d8 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:23.382966 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c7b1a119-c10f-4e0b-9912-d88f060ba5d8 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:23.383416 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c7b1a119-c10f-4e0b-9912-d88f060ba5d8 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:23.401699 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=100 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:23.514580 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c7b1a119-c10f-4e0b-9912-d88f060ba5d8 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:23.526738 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c7b1a119-c10f-4e0b-9912-d88f060ba5d8 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1504 microversion: 2.1 time: 0.155698 Jun 16 00:29:23.527287 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 129/263] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:23 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:23.995871 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-ebc79419-d0e7-41ff-8668-bfbdb74479f8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:23.996393 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-ebc79419-d0e7-41ff-8668-bfbdb74479f8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:24.002410 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ebc79419-d0e7-41ff-8668-bfbdb74479f8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:24.002848 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ebc79419-d0e7-41ff-8668-bfbdb74479f8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:24.003593 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ebc79419-d0e7-41ff-8668-bfbdb74479f8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:24.004025 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ebc79419-d0e7-41ff-8668-bfbdb74479f8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:24.071713 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-faa42bb1-bccf-43cb-b79f-c61d177a31cb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:24.072307 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-faa42bb1-bccf-43cb-b79f-c61d177a31cb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:24.078642 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-faa42bb1-bccf-43cb-b79f-c61d177a31cb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:24.079084 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-faa42bb1-bccf-43cb-b79f-c61d177a31cb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:24.079839 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-faa42bb1-bccf-43cb-b79f-c61d177a31cb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:24.080268 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-faa42bb1-bccf-43cb-b79f-c61d177a31cb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:24.133721 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-ebc79419-d0e7-41ff-8668-bfbdb74479f8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:24.141732 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-ebc79419-d0e7-41ff-8668-bfbdb74479f8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:24.143209 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-ebc79419-d0e7-41ff-8668-bfbdb74479f8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:24.144374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-ebc79419-d0e7-41ff-8668-bfbdb74479f8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1724 microversion: 2.20 time: 0.152445 Jun 16 00:29:24.145092 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 135/264] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:23 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:24.218015 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-faa42bb1-bccf-43cb-b79f-c61d177a31cb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:24.226198 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-faa42bb1-bccf-43cb-b79f-c61d177a31cb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1509 microversion: 2.1 time: 0.159019 Jun 16 00:29:24.226767 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 130/265] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:24 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:24.543163 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-cf923b69-4c6f-41cb-a279-6c61ee017a40 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:24.543962 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-cf923b69-4c6f-41cb-a279-6c61ee017a40 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:24.553164 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cf923b69-4c6f-41cb-a279-6c61ee017a40 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:24.553639 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cf923b69-4c6f-41cb-a279-6c61ee017a40 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:24.554457 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cf923b69-4c6f-41cb-a279-6c61ee017a40 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:24.555021 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cf923b69-4c6f-41cb-a279-6c61ee017a40 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:24.689044 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-cf923b69-4c6f-41cb-a279-6c61ee017a40 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:24.696597 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-cf923b69-4c6f-41cb-a279-6c61ee017a40 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1504 microversion: 2.1 time: 0.157183 Jun 16 00:29:24.697182 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 136/266] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:24 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:25.162502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-a44b5df4-23d0-45aa-8ac3-04c89847800b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:25.163955 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-a44b5df4-23d0-45aa-8ac3-04c89847800b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:25.170830 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a44b5df4-23d0-45aa-8ac3-04c89847800b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:25.171267 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a44b5df4-23d0-45aa-8ac3-04c89847800b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:25.172017 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a44b5df4-23d0-45aa-8ac3-04c89847800b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:25.172444 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a44b5df4-23d0-45aa-8ac3-04c89847800b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:25.244293 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-185d42b8-6d8b-4fe1-a20d-ea16c8c64652 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:25.244914 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-185d42b8-6d8b-4fe1-a20d-ea16c8c64652 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:25.251115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-185d42b8-6d8b-4fe1-a20d-ea16c8c64652 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:25.252209 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-185d42b8-6d8b-4fe1-a20d-ea16c8c64652 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:25.254683 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-185d42b8-6d8b-4fe1-a20d-ea16c8c64652 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:25.255593 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-185d42b8-6d8b-4fe1-a20d-ea16c8c64652 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:25.306459 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a44b5df4-23d0-45aa-8ac3-04c89847800b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:25.314396 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a44b5df4-23d0-45aa-8ac3-04c89847800b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:25.315943 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a44b5df4-23d0-45aa-8ac3-04c89847800b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:25.317394 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-a44b5df4-23d0-45aa-8ac3-04c89847800b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1724 microversion: 2.20 time: 0.158967 Jun 16 00:29:25.318269 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 131/267] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:25 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:25.384991 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-185d42b8-6d8b-4fe1-a20d-ea16c8c64652 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:25.392338 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-185d42b8-6d8b-4fe1-a20d-ea16c8c64652 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1509 microversion: 2.1 time: 0.152654 Jun 16 00:29:25.392909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 137/268] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:25 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:25.714235 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-883e118c-c4d4-4856-a3b7-84bb29b1c080 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:25.714835 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-883e118c-c4d4-4856-a3b7-84bb29b1c080 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:25.727879 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-883e118c-c4d4-4856-a3b7-84bb29b1c080 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:25.727879 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-883e118c-c4d4-4856-a3b7-84bb29b1c080 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:25.727879 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-883e118c-c4d4-4856-a3b7-84bb29b1c080 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:25.727879 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-883e118c-c4d4-4856-a3b7-84bb29b1c080 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:25.875099 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-883e118c-c4d4-4856-a3b7-84bb29b1c080 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:25.884123 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-883e118c-c4d4-4856-a3b7-84bb29b1c080 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1504 microversion: 2.1 time: 0.174055 Jun 16 00:29:25.884689 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 132/269] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:25 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:26.335712 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-22f28d76-de95-48fa-a901-5bd0b6e861aa tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:26.336320 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-22f28d76-de95-48fa-a901-5bd0b6e861aa tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:26.342593 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-22f28d76-de95-48fa-a901-5bd0b6e861aa tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:26.343038 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-22f28d76-de95-48fa-a901-5bd0b6e861aa tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:26.343795 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-22f28d76-de95-48fa-a901-5bd0b6e861aa tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:26.344220 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-22f28d76-de95-48fa-a901-5bd0b6e861aa tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:26.409995 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d8165191-5883-4368-ae46-56a2f347166d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:26.410725 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d8165191-5883-4368-ae46-56a2f347166d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:26.417992 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d8165191-5883-4368-ae46-56a2f347166d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:26.418525 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d8165191-5883-4368-ae46-56a2f347166d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:26.419381 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d8165191-5883-4368-ae46-56a2f347166d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:26.419882 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d8165191-5883-4368-ae46-56a2f347166d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:26.520000 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-22f28d76-de95-48fa-a901-5bd0b6e861aa tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:26.529146 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-22f28d76-de95-48fa-a901-5bd0b6e861aa tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:26.530754 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-22f28d76-de95-48fa-a901-5bd0b6e861aa tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:26.531988 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-22f28d76-de95-48fa-a901-5bd0b6e861aa tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1745 microversion: 2.20 time: 0.200395 Jun 16 00:29:26.532644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 138/270] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:26 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1745 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:26.619171 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d8165191-5883-4368-ae46-56a2f347166d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:26.626700 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d8165191-5883-4368-ae46-56a2f347166d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1509 microversion: 2.1 time: 0.220593 Jun 16 00:29:26.627355 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 133/271] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:26 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1509 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:26.901744 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-3ce4c418-076f-4708-bbec-8c3e09286e45 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:26.902488 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-3ce4c418-076f-4708-bbec-8c3e09286e45 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:26.909267 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3ce4c418-076f-4708-bbec-8c3e09286e45 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:26.909718 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3ce4c418-076f-4708-bbec-8c3e09286e45 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:26.910484 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3ce4c418-076f-4708-bbec-8c3e09286e45 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:26.911323 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3ce4c418-076f-4708-bbec-8c3e09286e45 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:27.061397 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-3ce4c418-076f-4708-bbec-8c3e09286e45 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:27.070021 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-3ce4c418-076f-4708-bbec-8c3e09286e45 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1504 microversion: 2.1 time: 0.172179 Jun 16 00:29:27.070698 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 139/272] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:26 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:27.550705 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-6ca8f107-7456-43c5-98de-abfee5bd920a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:27.551380 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-6ca8f107-7456-43c5-98de-abfee5bd920a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:27.558457 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6ca8f107-7456-43c5-98de-abfee5bd920a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:27.558831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6ca8f107-7456-43c5-98de-abfee5bd920a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:27.559582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6ca8f107-7456-43c5-98de-abfee5bd920a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:27.560359 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6ca8f107-7456-43c5-98de-abfee5bd920a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:27.644826 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-80d2a068-7d90-4c9f-a531-dda3b3af9f79 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:27.647032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-80d2a068-7d90-4c9f-a531-dda3b3af9f79 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:27.653540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-80d2a068-7d90-4c9f-a531-dda3b3af9f79 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:27.654439 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-80d2a068-7d90-4c9f-a531-dda3b3af9f79 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:27.655479 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-80d2a068-7d90-4c9f-a531-dda3b3af9f79 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:27.655938 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-80d2a068-7d90-4c9f-a531-dda3b3af9f79 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:27.726607 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-6ca8f107-7456-43c5-98de-abfee5bd920a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:27.735062 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-6ca8f107-7456-43c5-98de-abfee5bd920a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:27.736578 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-6ca8f107-7456-43c5-98de-abfee5bd920a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:27.737743 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-6ca8f107-7456-43c5-98de-abfee5bd920a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1745 microversion: 2.20 time: 0.191037 Jun 16 00:29:27.738303 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 134/273] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:27 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1745 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:27.821268 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-80d2a068-7d90-4c9f-a531-dda3b3af9f79 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:27.828762 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-80d2a068-7d90-4c9f-a531-dda3b3af9f79 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1509 microversion: 2.1 time: 0.187932 Jun 16 00:29:27.829361 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 140/274] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:27 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:28.090980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-279ec0c8-c3a3-4246-8aaf-95284f485c58 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:28.091882 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-279ec0c8-c3a3-4246-8aaf-95284f485c58 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:28.099089 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-279ec0c8-c3a3-4246-8aaf-95284f485c58 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:28.102714 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-279ec0c8-c3a3-4246-8aaf-95284f485c58 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:28.102714 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-279ec0c8-c3a3-4246-8aaf-95284f485c58 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:28.102714 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-279ec0c8-c3a3-4246-8aaf-95284f485c58 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:28.247692 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-279ec0c8-c3a3-4246-8aaf-95284f485c58 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:28.256174 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-279ec0c8-c3a3-4246-8aaf-95284f485c58 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1504 microversion: 2.1 time: 0.172920 Jun 16 00:29:28.256746 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 135/275] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:28 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:28.759230 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d195a5b7-585a-483a-90c1-4e1dc2baa399 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:28.759842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-d195a5b7-585a-483a-90c1-4e1dc2baa399 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:28.765927 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d195a5b7-585a-483a-90c1-4e1dc2baa399 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:28.766375 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d195a5b7-585a-483a-90c1-4e1dc2baa399 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:28.767138 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d195a5b7-585a-483a-90c1-4e1dc2baa399 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:28.767572 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d195a5b7-585a-483a-90c1-4e1dc2baa399 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:28.786972 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:28.847223 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-40cae16d-2202-480c-8c3d-73fac9cdbfee tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:28.847826 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-40cae16d-2202-480c-8c3d-73fac9cdbfee tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:28.858896 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-40cae16d-2202-480c-8c3d-73fac9cdbfee tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:28.859349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-40cae16d-2202-480c-8c3d-73fac9cdbfee tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:28.860145 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-40cae16d-2202-480c-8c3d-73fac9cdbfee tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:28.860756 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-40cae16d-2202-480c-8c3d-73fac9cdbfee tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:28.932660 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d195a5b7-585a-483a-90c1-4e1dc2baa399 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:28.946784 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d195a5b7-585a-483a-90c1-4e1dc2baa399 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:28.948477 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d195a5b7-585a-483a-90c1-4e1dc2baa399 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:28.949752 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-d195a5b7-585a-483a-90c1-4e1dc2baa399 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1745 microversion: 2.20 time: 0.194610 Jun 16 00:29:28.950202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 141/276] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:28 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1745 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:29.011134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-40cae16d-2202-480c-8c3d-73fac9cdbfee tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:29.018488 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-40cae16d-2202-480c-8c3d-73fac9cdbfee tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1509 microversion: 2.1 time: 0.175011 Jun 16 00:29:29.019048 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 136/277] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:28 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:29.275620 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-1a8114f7-380c-4045-827d-08089815dfd9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:29.276226 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-1a8114f7-380c-4045-827d-08089815dfd9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:29.282904 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1a8114f7-380c-4045-827d-08089815dfd9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:29.283347 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1a8114f7-380c-4045-827d-08089815dfd9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:29.284159 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1a8114f7-380c-4045-827d-08089815dfd9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:29.284755 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1a8114f7-380c-4045-827d-08089815dfd9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:29.453595 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-1a8114f7-380c-4045-827d-08089815dfd9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:29.468504 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-1a8114f7-380c-4045-827d-08089815dfd9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1504 microversion: 2.1 time: 0.198795 Jun 16 00:29:29.469148 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 142/278] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:29 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1504 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:29.969227 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8c60ff13-b1ef-40c7-9023-98f5105060c4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:29.971380 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-8c60ff13-b1ef-40c7-9023-98f5105060c4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:29.979651 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8c60ff13-b1ef-40c7-9023-98f5105060c4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:29.980424 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8c60ff13-b1ef-40c7-9023-98f5105060c4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:29.981333 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8c60ff13-b1ef-40c7-9023-98f5105060c4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:29.981819 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8c60ff13-b1ef-40c7-9023-98f5105060c4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:30.039220 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-15b9da13-0003-46b9-9673-e34d9e9f7998 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:30.040071 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-15b9da13-0003-46b9-9673-e34d9e9f7998 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:30.047002 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-15b9da13-0003-46b9-9673-e34d9e9f7998 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:30.047453 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-15b9da13-0003-46b9-9673-e34d9e9f7998 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:30.048334 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-15b9da13-0003-46b9-9673-e34d9e9f7998 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:30.048791 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-15b9da13-0003-46b9-9673-e34d9e9f7998 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:30.220466 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-15b9da13-0003-46b9-9673-e34d9e9f7998 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:30.231990 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-15b9da13-0003-46b9-9673-e34d9e9f7998 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1509 microversion: 2.1 time: 0.199360 Jun 16 00:29:30.233052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 143/279] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:30 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1509 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:30.237712 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-99a2b401-a12b-4d6d-b048-96bc5f0b89ce req-e4b6ecb7-c25d-4925-b7ab-59aac1156ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f646dde-c456-4155-b320-b7c064ce7a0a", "name": "network-vif-deleted", "tag": "feb863ac-07e7-46a6-b1d2-ad7d51aae6d4"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:29:30.246066 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-99a2b401-a12b-4d6d-b048-96bc5f0b89ce req-e4b6ecb7-c25d-4925-b7ab-59aac1156ecd service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:30.246865 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-99a2b401-a12b-4d6d-b048-96bc5f0b89ce req-e4b6ecb7-c25d-4925-b7ab-59aac1156ecd service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:30.259457 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-99a2b401-a12b-4d6d-b048-96bc5f0b89ce req-e4b6ecb7-c25d-4925-b7ab-59aac1156ecd service nova] Creating event network-vif-deleted:feb863ac-07e7-46a6-b1d2-ad7d51aae6d4 for instance 9f646dde-c456-4155-b320-b7c064ce7a0a on hv-cinder-84599 Jun 16 00:29:30.259996 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-8c60ff13-b1ef-40c7-9023-98f5105060c4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:30.264677 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-99a2b401-a12b-4d6d-b048-96bc5f0b89ce req-e4b6ecb7-c25d-4925-b7ab-59aac1156ecd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030428 Jun 16 00:29:30.265495 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 144/280] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:29:30.269428 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-8c60ff13-b1ef-40c7-9023-98f5105060c4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:30.272425 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-8c60ff13-b1ef-40c7-9023-98f5105060c4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:30.273634 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-8c60ff13-b1ef-40c7-9023-98f5105060c4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1745 microversion: 2.20 time: 0.309806 Jun 16 00:29:30.274624 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 137/281] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:29 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1745 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:30.490389 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-7459ceb4-d16e-480a-9866-220e74d16a17 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:30.490997 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-7459ceb4-d16e-480a-9866-220e74d16a17 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:30.497334 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7459ceb4-d16e-480a-9866-220e74d16a17 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:30.497782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7459ceb4-d16e-480a-9866-220e74d16a17 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:30.498585 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7459ceb4-d16e-480a-9866-220e74d16a17 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:30.499022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7459ceb4-d16e-480a-9866-220e74d16a17 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:30.529794 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7459ceb4-d16e-480a-9866-220e74d16a17 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:30.530240 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7459ceb4-d16e-480a-9866-220e74d16a17 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:30.530681 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.objects.instance [None req-7459ceb4-d16e-480a-9866-220e74d16a17 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lazy-loading 'fault' on Instance uuid 9f646dde-c456-4155-b320-b7c064ce7a0a {{(pid=124231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:29:30.578664 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-7459ceb4-d16e-480a-9866-220e74d16a17 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:30.587123 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-7459ceb4-d16e-480a-9866-220e74d16a17 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1304 microversion: 2.1 time: 0.101771 Jun 16 00:29:30.587628 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 145/282] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:30 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:31.249698 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-0d80d6fb-0f1c-45e4-99c2-a5322b104714 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:31.250408 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-0d80d6fb-0f1c-45e4-99c2-a5322b104714 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:31.257506 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0d80d6fb-0f1c-45e4-99c2-a5322b104714 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:31.257947 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0d80d6fb-0f1c-45e4-99c2-a5322b104714 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:31.258698 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0d80d6fb-0f1c-45e4-99c2-a5322b104714 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:31.259125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0d80d6fb-0f1c-45e4-99c2-a5322b104714 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:31.295296 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-6a21a6cd-34ef-41cf-acd0-3d66dc8003cc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:31.296020 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-6a21a6cd-34ef-41cf-acd0-3d66dc8003cc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:31.303112 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6a21a6cd-34ef-41cf-acd0-3d66dc8003cc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:31.303555 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6a21a6cd-34ef-41cf-acd0-3d66dc8003cc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:31.304386 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6a21a6cd-34ef-41cf-acd0-3d66dc8003cc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:31.304818 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6a21a6cd-34ef-41cf-acd0-3d66dc8003cc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:31.413237 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0d80d6fb-0f1c-45e4-99c2-a5322b104714 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:31.420803 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-0d80d6fb-0f1c-45e4-99c2-a5322b104714 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1509 microversion: 2.1 time: 0.174997 Jun 16 00:29:31.421407 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 138/283] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:31 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:31.448723 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-6a21a6cd-34ef-41cf-acd0-3d66dc8003cc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:31.456684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-6a21a6cd-34ef-41cf-acd0-3d66dc8003cc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:31.458274 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-6a21a6cd-34ef-41cf-acd0-3d66dc8003cc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:31.459507 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-6a21a6cd-34ef-41cf-acd0-3d66dc8003cc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1745 microversion: 2.20 time: 0.171765 Jun 16 00:29:31.460273 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 146/284] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:31 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:29:31.603545 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-13a069c6-2889-46fa-89ec-0ef386cf6a7e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:31.604281 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-13a069c6-2889-46fa-89ec-0ef386cf6a7e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:31.610207 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-13a069c6-2889-46fa-89ec-0ef386cf6a7e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:31.610655 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-13a069c6-2889-46fa-89ec-0ef386cf6a7e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:31.611417 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-13a069c6-2889-46fa-89ec-0ef386cf6a7e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:31.611848 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-13a069c6-2889-46fa-89ec-0ef386cf6a7e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:31.644469 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-13a069c6-2889-46fa-89ec-0ef386cf6a7e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:31.644829 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-13a069c6-2889-46fa-89ec-0ef386cf6a7e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:31.645313 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.objects.instance [None req-13a069c6-2889-46fa-89ec-0ef386cf6a7e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lazy-loading 'fault' on Instance uuid 9f646dde-c456-4155-b320-b7c064ce7a0a {{(pid=124230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:29:31.691133 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-13a069c6-2889-46fa-89ec-0ef386cf6a7e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:31.699675 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-13a069c6-2889-46fa-89ec-0ef386cf6a7e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1304 microversion: 2.1 time: 0.099915 Jun 16 00:29:31.700242 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 139/285] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:31 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:32.033030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-e2ddd960-51a7-4e0c-a71c-6c745b8b9b9d req-fd676092-2c99-4df6-8cfb-84154360ff72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b227643-24e7-44b6-acf7-d3801014a8c7", "name": "network-vif-plugged", "status": "completed", "tag": "c88ef649-3637-4f5d-955c-f88ebc0bb6c5"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:29:32.043302 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-e2ddd960-51a7-4e0c-a71c-6c745b8b9b9d req-fd676092-2c99-4df6-8cfb-84154360ff72 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:32.043638 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-e2ddd960-51a7-4e0c-a71c-6c745b8b9b9d req-fd676092-2c99-4df6-8cfb-84154360ff72 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:32.055612 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-e2ddd960-51a7-4e0c-a71c-6c745b8b9b9d req-fd676092-2c99-4df6-8cfb-84154360ff72 service nova] Creating event network-vif-plugged:c88ef649-3637-4f5d-955c-f88ebc0bb6c5 for instance 6b227643-24e7-44b6-acf7-d3801014a8c7 on hv-cinder-84599 Jun 16 00:29:32.060459 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-e2ddd960-51a7-4e0c-a71c-6c745b8b9b9d req-fd676092-2c99-4df6-8cfb-84154360ff72 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031539 Jun 16 00:29:32.061081 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 147/286] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:29:32.438262 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-bf4afb77-b8c5-4392-9ee3-4cd5a427d9dc tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:32.438855 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-bf4afb77-b8c5-4392-9ee3-4cd5a427d9dc tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:32.445861 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bf4afb77-b8c5-4392-9ee3-4cd5a427d9dc tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:32.446305 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bf4afb77-b8c5-4392-9ee3-4cd5a427d9dc tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:32.447062 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bf4afb77-b8c5-4392-9ee3-4cd5a427d9dc tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:32.447493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bf4afb77-b8c5-4392-9ee3-4cd5a427d9dc tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:32.478010 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-815c8c80-2c45-4699-bec9-bec16db82946 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:32.478707 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-815c8c80-2c45-4699-bec9-bec16db82946 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:32.484985 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-815c8c80-2c45-4699-bec9-bec16db82946 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:32.485436 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-815c8c80-2c45-4699-bec9-bec16db82946 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:32.486205 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-815c8c80-2c45-4699-bec9-bec16db82946 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:32.486634 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-815c8c80-2c45-4699-bec9-bec16db82946 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:32.594836 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-bf4afb77-b8c5-4392-9ee3-4cd5a427d9dc tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:32.602959 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-bf4afb77-b8c5-4392-9ee3-4cd5a427d9dc tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1509 microversion: 2.1 time: 0.168440 Jun 16 00:29:32.603964 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 140/287] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:32 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:32.631931 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-815c8c80-2c45-4699-bec9-bec16db82946 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:32.639958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-815c8c80-2c45-4699-bec9-bec16db82946 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:32.641663 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-815c8c80-2c45-4699-bec9-bec16db82946 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:32.642811 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-815c8c80-2c45-4699-bec9-bec16db82946 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1745 microversion: 2.20 time: 0.169218 Jun 16 00:29:32.643368 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 148/288] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:32 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:29:32.716524 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b7783a4d-0068-4135-b775-2c929b858ecb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:32.717149 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-b7783a4d-0068-4135-b775-2c929b858ecb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:32.723949 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b7783a4d-0068-4135-b775-2c929b858ecb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:32.724403 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b7783a4d-0068-4135-b775-2c929b858ecb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:32.725359 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b7783a4d-0068-4135-b775-2c929b858ecb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:32.725796 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b7783a4d-0068-4135-b775-2c929b858ecb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:32.758641 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b7783a4d-0068-4135-b775-2c929b858ecb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:32.759086 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b7783a4d-0068-4135-b775-2c929b858ecb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:32.759532 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.objects.instance [None req-b7783a4d-0068-4135-b775-2c929b858ecb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lazy-loading 'fault' on Instance uuid 9f646dde-c456-4155-b320-b7c064ce7a0a {{(pid=124230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:29:32.799477 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b7783a4d-0068-4135-b775-2c929b858ecb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:32.807324 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-b7783a4d-0068-4135-b775-2c929b858ecb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1304 microversion: 2.1 time: 0.094970 Jun 16 00:29:32.807884 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 141/289] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:32 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:33.622637 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-51160b8f-6e96-4976-9916-902551218b51 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:33.623235 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-51160b8f-6e96-4976-9916-902551218b51 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:33.629336 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-51160b8f-6e96-4976-9916-902551218b51 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:33.629838 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-51160b8f-6e96-4976-9916-902551218b51 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:33.630671 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-51160b8f-6e96-4976-9916-902551218b51 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:33.631101 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-51160b8f-6e96-4976-9916-902551218b51 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:33.662285 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-af6b993b-edc8-451a-a35a-ca96e8672d33 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:33.662963 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-af6b993b-edc8-451a-a35a-ca96e8672d33 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:33.669676 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-af6b993b-edc8-451a-a35a-ca96e8672d33 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:33.670121 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-af6b993b-edc8-451a-a35a-ca96e8672d33 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:33.670896 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-af6b993b-edc8-451a-a35a-ca96e8672d33 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:33.671331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-af6b993b-edc8-451a-a35a-ca96e8672d33 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:33.780526 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-51160b8f-6e96-4976-9916-902551218b51 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:33.788546 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-51160b8f-6e96-4976-9916-902551218b51 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1509 microversion: 2.1 time: 0.169678 Jun 16 00:29:33.789137 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 149/290] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:33 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:33.810443 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-af6b993b-edc8-451a-a35a-ca96e8672d33 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:33.819032 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-af6b993b-edc8-451a-a35a-ca96e8672d33 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:33.820547 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-af6b993b-edc8-451a-a35a-ca96e8672d33 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:33.821734 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-af6b993b-edc8-451a-a35a-ca96e8672d33 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1745 microversion: 2.20 time: 0.163845 Jun 16 00:29:33.822295 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 142/291] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:33 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:29:33.823498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-84988933-8777-4fd7-94fe-a2112df944ca tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:33.824095 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-84988933-8777-4fd7-94fe-a2112df944ca tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:33.830012 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-84988933-8777-4fd7-94fe-a2112df944ca tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:33.830456 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-84988933-8777-4fd7-94fe-a2112df944ca tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:33.831197 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-84988933-8777-4fd7-94fe-a2112df944ca tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:33.831623 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-84988933-8777-4fd7-94fe-a2112df944ca tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:33.862849 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-84988933-8777-4fd7-94fe-a2112df944ca tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:33.863293 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-84988933-8777-4fd7-94fe-a2112df944ca tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:33.863731 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.objects.instance [None req-84988933-8777-4fd7-94fe-a2112df944ca tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lazy-loading 'fault' on Instance uuid 9f646dde-c456-4155-b320-b7c064ce7a0a {{(pid=124231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:29:33.903747 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-84988933-8777-4fd7-94fe-a2112df944ca tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:33.910990 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-84988933-8777-4fd7-94fe-a2112df944ca tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1304 microversion: 2.1 time: 0.091183 Jun 16 00:29:33.912325 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 150/292] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:33 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:34.806084 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-12d762f7-33b9-49cb-887f-b37d46ff6758 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:34.806717 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-12d762f7-33b9-49cb-887f-b37d46ff6758 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:34.813558 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-12d762f7-33b9-49cb-887f-b37d46ff6758 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:34.814100 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-12d762f7-33b9-49cb-887f-b37d46ff6758 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:34.814977 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-12d762f7-33b9-49cb-887f-b37d46ff6758 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:34.815414 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-12d762f7-33b9-49cb-887f-b37d46ff6758 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:34.839447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-cc91240a-8a5a-46b2-ba00-483a380e29e6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:34.840055 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-cc91240a-8a5a-46b2-ba00-483a380e29e6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:34.847760 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cc91240a-8a5a-46b2-ba00-483a380e29e6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:34.848278 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cc91240a-8a5a-46b2-ba00-483a380e29e6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:34.849817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cc91240a-8a5a-46b2-ba00-483a380e29e6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:34.850111 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cc91240a-8a5a-46b2-ba00-483a380e29e6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:34.955528 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-12d762f7-33b9-49cb-887f-b37d46ff6758 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:34.964969 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-12d762f7-33b9-49cb-887f-b37d46ff6758 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1509 microversion: 2.1 time: 0.163265 Jun 16 00:29:34.965541 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 143/293] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:34 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:34.970010 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-3b8586c9-e5a7-44e6-a631-ef4041522b4f tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:34.970816 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-3b8586c9-e5a7-44e6-a631-ef4041522b4f tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:34.977079 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3b8586c9-e5a7-44e6-a631-ef4041522b4f tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:34.977521 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3b8586c9-e5a7-44e6-a631-ef4041522b4f tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:34.978269 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3b8586c9-e5a7-44e6-a631-ef4041522b4f tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:34.978696 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3b8586c9-e5a7-44e6-a631-ef4041522b4f tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:34.984564 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-cc91240a-8a5a-46b2-ba00-483a380e29e6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:34.993347 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-cc91240a-8a5a-46b2-ba00-483a380e29e6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:34.994887 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-cc91240a-8a5a-46b2-ba00-483a380e29e6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:34.996032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-cc91240a-8a5a-46b2-ba00-483a380e29e6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1745 microversion: 2.20 time: 0.160447 Jun 16 00:29:34.996582 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 151/294] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:34 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:29:35.010201 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3b8586c9-e5a7-44e6-a631-ef4041522b4f tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:35.010647 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3b8586c9-e5a7-44e6-a631-ef4041522b4f tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:35.011084 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.objects.instance [None req-3b8586c9-e5a7-44e6-a631-ef4041522b4f tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lazy-loading 'fault' on Instance uuid 9f646dde-c456-4155-b320-b7c064ce7a0a {{(pid=124230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:29:35.054321 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-3b8586c9-e5a7-44e6-a631-ef4041522b4f tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:35.061605 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-3b8586c9-e5a7-44e6-a631-ef4041522b4f tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 200 len: 1304 microversion: 2.1 time: 0.095150 Jun 16 00:29:35.062161 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 144/295] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:34 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:35.982863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-1795aabd-461f-4a06-bb98-272998b5646b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:35.983461 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-1795aabd-461f-4a06-bb98-272998b5646b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:35.992309 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1795aabd-461f-4a06-bb98-272998b5646b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:35.992661 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1795aabd-461f-4a06-bb98-272998b5646b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:35.993443 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1795aabd-461f-4a06-bb98-272998b5646b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:35.993872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1795aabd-461f-4a06-bb98-272998b5646b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:36.014048 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-54fd8efe-338a-4b9c-b8a5-f262c0ae0390 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:36.014708 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-54fd8efe-338a-4b9c-b8a5-f262c0ae0390 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:36.022803 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-54fd8efe-338a-4b9c-b8a5-f262c0ae0390 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:36.023250 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-54fd8efe-338a-4b9c-b8a5-f262c0ae0390 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:36.024015 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-54fd8efe-338a-4b9c-b8a5-f262c0ae0390 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:36.024444 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-54fd8efe-338a-4b9c-b8a5-f262c0ae0390 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:36.028559 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=100 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:36.143689 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-1795aabd-461f-4a06-bb98-272998b5646b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:36.155745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-1795aabd-461f-4a06-bb98-272998b5646b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1509 microversion: 2.1 time: 0.177256 Jun 16 00:29:36.156412 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 152/296] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:35 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:36.162318 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-51122fb9-93fa-40ca-9b71-9eea72b188ee tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:36.162912 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-51122fb9-93fa-40ca-9b71-9eea72b188ee tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 9f646dde-c456-4155-b320-b7c064ce7a0a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:36.165076 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-54fd8efe-338a-4b9c-b8a5-f262c0ae0390 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:36.169410 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-51122fb9-93fa-40ca-9b71-9eea72b188ee tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:36.170227 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-51122fb9-93fa-40ca-9b71-9eea72b188ee tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:36.170995 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-51122fb9-93fa-40ca-9b71-9eea72b188ee tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:36.171417 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-51122fb9-93fa-40ca-9b71-9eea72b188ee tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:36.176949 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-54fd8efe-338a-4b9c-b8a5-f262c0ae0390 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:36.178841 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-54fd8efe-338a-4b9c-b8a5-f262c0ae0390 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:36.180311 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-54fd8efe-338a-4b9c-b8a5-f262c0ae0390 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1745 microversion: 2.20 time: 0.170120 Jun 16 00:29:36.180979 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 145/297] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:36 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:29:36.186540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-51122fb9-93fa-40ca-9b71-9eea72b188ee tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] HTTP exception thrown: Instance 9f646dde-c456-4155-b320-b7c064ce7a0a could not be found. Jun 16 00:29:36.188207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-51122fb9-93fa-40ca-9b71-9eea72b188ee tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Request method failure captured: Jun 16 00:29:36.188207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a HTTP/1.1 Jun 16 00:29:36.188207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:29:36.188207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:29:36.188207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:29:36.188207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:29:36.188207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:29:36.188207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:29:36.188207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:29:36.188207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:29:36.188207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnlMh_Uf7XK91_LDaiz6gJztsUZs6AcB0dWWOMq7br_s59P9EoxRg9RH9F_MxaZVL75qKYoRzHVnI7tjoGQ5weTTC8u0jhxppN5ZIVkJ2a0MBJVh3LQNCT0pY-ouqVnYhcINLEO155KXZztPWYFWsXpN5WBliVH5QZafGgEIEBcDr7Q Jun 16 00:29:36.188207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:29:36.188207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:29:36.188207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:29:36.188207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:29:36.188207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:29:36.188207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:29:36.188207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: c8055262b50d4e93b290315d0e57bd70 Jun 16 00:29:36.188207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-VolumesActionsTest-215830791 Jun 16 00:29:36.188207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:29:36.188207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:29:36.190157 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8055262b50d4e93b290315d0e57bd70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8055262b50d4e93b290315d0e57bd70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8055262b50d4e93b290315d0e57bd70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8055262b50d4e93b290315d0e57bd70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:29:36.190157 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-VolumesActionsTest-215830791 Jun 16 00:29:36.190157 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: c8055262b50d4e93b290315d0e57bd70 Jun 16 00:29:36.190157 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-VolumesActionsTest-215830791 Jun 16 00:29:36.190157 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-VolumesActionsTest-215830791-project Jun 16 00:29:36.190157 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:29:36.190157 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:29:36.190157 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: ac38b6c63c1649d68302de51cc3424c1 Jun 16 00:29:36.190157 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-VolumesActionsTest-215830791-project Jun 16 00:29:36.190157 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:29:36.190157 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Instance 9f646dde-c456-4155-b320-b7c064ce7a0a could not be found. Jun 16 00:29:36.190157 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': '9f646dde-c456-4155-b320-b7c064ce7a0a'} Jun 16 00:29:36.190962 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:29:36.190962 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:29:36.190962 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:29:36.190962 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:29:36.190962 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:29:36.190962 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:29:36.190962 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:29:36.190962 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:29:36.190962 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:29:36.190962 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:29:36.190962 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f646dde-c456-4155-b320-b7c064ce7a0a could not be found. Jun 16 00:29:36.190962 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:29:36.190962 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:29:36.190962 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:29:36.190962 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:29:36.190962 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:29:36.190962 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:29:36.190962 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:29:36.190962 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:29:36.190962 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:29:36.193004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:29:36.193004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:29:36.193004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:29:36.193004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:29:36.193004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:29:36.193004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:29:36.193004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:29:36.193004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f646dde-c456-4155-b320-b7c064ce7a0a could not be found. Jun 16 00:29:36.193004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:29:36.193004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:29:36.193004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:29:36.193004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:29:36.193004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:29:36.193004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:29:36.193004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:29:36.193004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:29:36.193004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f646dde-c456-4155-b320-b7c064ce7a0a could not be found. Jun 16 00:29:36.193004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:29:36.194524 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-51122fb9-93fa-40ca-9b71-9eea72b188ee tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Returning 404 to user: Instance 9f646dde-c456-4155-b320-b7c064ce7a0a could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:29:36.194524 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-51122fb9-93fa-40ca-9b71-9eea72b188ee tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a" status: 404 len: 111 microversion: 2.1 time: 0.031827 Jun 16 00:29:36.194524 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 153/298] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:36 2022] GET /compute/v2.1/servers/9f646dde-c456-4155-b320-b7c064ce7a0a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:29:36.335833 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d9cfa017-1398-4fac-bfc5-ba61338c11f2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1901536817", "imageRef": "d9a6de24-7a5e-4f8b-b078-809c87b15d56", "flavorRef": "452", "networks": [{"uuid": "dd5ef2eb-9bfb-4b81-a8ae-1fa0ffb5bea4"}]}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:29:37.174305 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-cb6d10b5-82be-43de-8c3e-9b92404a61bd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:37.174937 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-cb6d10b5-82be-43de-8c3e-9b92404a61bd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:37.181992 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cb6d10b5-82be-43de-8c3e-9b92404a61bd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:37.182437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cb6d10b5-82be-43de-8c3e-9b92404a61bd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:37.183189 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cb6d10b5-82be-43de-8c3e-9b92404a61bd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:37.183616 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cb6d10b5-82be-43de-8c3e-9b92404a61bd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:37.324321 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-cb6d10b5-82be-43de-8c3e-9b92404a61bd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:37.333350 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-cb6d10b5-82be-43de-8c3e-9b92404a61bd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1515 microversion: 2.1 time: 0.162200 Jun 16 00:29:37.334393 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 154/299] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:37 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:37.339052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-4921b1ca-0a02-4176-9ab6-c27313b92546 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:37.339649 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-4921b1ca-0a02-4176-9ab6-c27313b92546 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:37.345437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4921b1ca-0a02-4176-9ab6-c27313b92546 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:37.345825 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4921b1ca-0a02-4176-9ab6-c27313b92546 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:37.346581 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4921b1ca-0a02-4176-9ab6-c27313b92546 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:37.347017 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4921b1ca-0a02-4176-9ab6-c27313b92546 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:37.493472 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-4921b1ca-0a02-4176-9ab6-c27313b92546 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:37.501839 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-4921b1ca-0a02-4176-9ab6-c27313b92546 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:37.503499 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-4921b1ca-0a02-4176-9ab6-c27313b92546 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:37.506019 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-4921b1ca-0a02-4176-9ab6-c27313b92546 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1740 microversion: 2.20 time: 0.169547 Jun 16 00:29:37.506575 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 155/300] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:37 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:38.525933 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-0bc4a1d9-10ee-4257-8ef6-48ede4352264 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:38.526637 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-0bc4a1d9-10ee-4257-8ef6-48ede4352264 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:38.532559 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0bc4a1d9-10ee-4257-8ef6-48ede4352264 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:38.533026 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0bc4a1d9-10ee-4257-8ef6-48ede4352264 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:38.533776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0bc4a1d9-10ee-4257-8ef6-48ede4352264 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:38.534201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0bc4a1d9-10ee-4257-8ef6-48ede4352264 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:38.666581 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-0bc4a1d9-10ee-4257-8ef6-48ede4352264 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:38.675159 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-0bc4a1d9-10ee-4257-8ef6-48ede4352264 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:38.677054 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-0bc4a1d9-10ee-4257-8ef6-48ede4352264 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:38.678856 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-0bc4a1d9-10ee-4257-8ef6-48ede4352264 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1740 microversion: 2.20 time: 0.157987 Jun 16 00:29:38.689766 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 156/301] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:38 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:29:38.704268 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b32fb528-ec4c-4eef-9896-6d89c6b355ac tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Action: 'create', calling method: .version_select at 0x7fe704d57940>, body: {"keypair": {"name": "tempest-keypair-2020004617", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLI3rp6119C2HpU9JMMveFSuB2BiL3TVi1zPmGEIPlO330gMaPKuNYn76U4uzmaM1uXNdaicBeAJ9pIm2vvwxDFrnwyNm1u5Vuc+amJ71Fm8akRoLYPO/uC97FfKliEXcA=="}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:29:38.719156 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-b32fb528-ec4c-4eef-9896-6d89c6b355ac tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Getting quotas for project 0e5f17f8ba8e4113a27a004ebb29917a. Resources: {'key_pairs'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:29:38.726094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-b32fb528-ec4c-4eef-9896-6d89c6b355ac tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Getting quotas for user b5f4125ecaec41e5ba5c4eaf00c43e07 and project 0e5f17f8ba8e4113a27a004ebb29917a. Resources: {'key_pairs'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:29:38.749195 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-b32fb528-ec4c-4eef-9896-6d89c6b355ac tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048556 Jun 16 00:29:38.749789 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 157/302] 10.222.0.23 () {60 vars in 1158 bytes} [Thu Jun 16 00:29:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:29:39.700040 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-6200c577-bbe8-4e83-a077-968529608a2a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:39.700778 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-6200c577-bbe8-4e83-a077-968529608a2a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:39.708084 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6200c577-bbe8-4e83-a077-968529608a2a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:39.709256 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6200c577-bbe8-4e83-a077-968529608a2a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:39.710232 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6200c577-bbe8-4e83-a077-968529608a2a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:39.710673 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6200c577-bbe8-4e83-a077-968529608a2a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:39.919165 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-6200c577-bbe8-4e83-a077-968529608a2a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:39.936391 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-6200c577-bbe8-4e83-a077-968529608a2a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:39.936391 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-6200c577-bbe8-4e83-a077-968529608a2a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:39.936391 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-6200c577-bbe8-4e83-a077-968529608a2a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1740 microversion: 2.20 time: 0.238167 Jun 16 00:29:39.936790 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 158/303] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:39 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:29:40.141538 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.network.neutron [None req-d9cfa017-1398-4fac-bfc5-ba61338c11f2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] validate_networks() for [('dd5ef2eb-9bfb-4b81-a8ae-1fa0ffb5bea4', None, None, None, None, None)] {{(pid=124230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:29:40.238869 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-f7f3fc6d-d669-4ffc-a2eb-22f6cd4b9c3a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-771337458", "imageRef": "d9a6de24-7a5e-4f8b-b078-809c87b15d56", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "256025e5-4dfc-4eb0-8191-836be075779a"}], "security_groups": [{"name": "tempest-securitygroup--1180719330"}], "key_name": "tempest-keypair-2020004617", "user_data": "}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:29:40.246782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:40.402985 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.network.neutron [None req-f7f3fc6d-d669-4ffc-a2eb-22f6cd4b9c3a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] validate_networks() for [('256025e5-4dfc-4eb0-8191-836be075779a', None, None, None, None, None)] {{(pid=124231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:29:40.560174 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-d9cfa017-1398-4fac-bfc5-ba61338c11f2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Flavor limits 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:29:40.560746 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-d9cfa017-1398-4fac-bfc5-ba61338c11f2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Image limits 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:29:40.561342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-d9cfa017-1398-4fac-bfc5-ba61338c11f2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Flavor pref 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:29:40.561844 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-d9cfa017-1398-4fac-bfc5-ba61338c11f2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Image pref 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:29:40.562488 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-d9cfa017-1398-4fac-bfc5-ba61338c11f2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:29:40.572690 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d9cfa017-1398-4fac-bfc5-ba61338c11f2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:40.573176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d9cfa017-1398-4fac-bfc5-ba61338c11f2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:40.574322 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d9cfa017-1398-4fac-bfc5-ba61338c11f2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:40.574907 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d9cfa017-1398-4fac-bfc5-ba61338c11f2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:40.594221 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-d9cfa017-1398-4fac-bfc5-ba61338c11f2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Getting quotas for project c8055262b50d4e93b290315d0e57bd70. Resources: {'ram', 'cores', 'instances'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:29:40.599588 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-d9cfa017-1398-4fac-bfc5-ba61338c11f2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Getting quotas for user ac38b6c63c1649d68302de51cc3424c1 and project c8055262b50d4e93b290315d0e57bd70. Resources: {'ram', 'cores', 'instances'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:29:40.612124 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d9cfa017-1398-4fac-bfc5-ba61338c11f2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Going to run 1 instances... {{(pid=124230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:29:40.614461 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d9cfa017-1398-4fac-bfc5-ba61338c11f2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 59e8ed9c-a1d0-4799-8602-3536fcb3e81f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d9a6de24-7a5e-4f8b-b078-809c87b15d56',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:29:40.669516 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d9cfa017-1398-4fac-bfc5-ba61338c11f2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.338408 Jun 16 00:29:40.670526 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 146/304] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Jun 16 00:29:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 4340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:29:40.680865 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-718fbec5-da3d-4ae9-9f14-4c245b5742d3 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:40.681503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-718fbec5-da3d-4ae9-9f14-4c245b5742d3 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 59e8ed9c-a1d0-4799-8602-3536fcb3e81f] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:40.768025 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-718fbec5-da3d-4ae9-9f14-4c245b5742d3 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:40.780425 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-718fbec5-da3d-4ae9-9f14-4c245b5742d3 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f" status: 200 len: 1214 microversion: 2.1 time: 0.103575 Jun 16 00:29:40.793263 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 147/305] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:40 2022] GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:40.949402 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-edd44432-8051-4722-a1c5-4c19f6d6c352 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:40.950004 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-edd44432-8051-4722-a1c5-4c19f6d6c352 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:40.959914 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-edd44432-8051-4722-a1c5-4c19f6d6c352 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:40.960358 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-edd44432-8051-4722-a1c5-4c19f6d6c352 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:40.962135 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-edd44432-8051-4722-a1c5-4c19f6d6c352 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:40.962587 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-edd44432-8051-4722-a1c5-4c19f6d6c352 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:41.236178 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-edd44432-8051-4722-a1c5-4c19f6d6c352 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:41.247532 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-edd44432-8051-4722-a1c5-4c19f6d6c352 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:41.249600 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-edd44432-8051-4722-a1c5-4c19f6d6c352 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:41.251339 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-edd44432-8051-4722-a1c5-4c19f6d6c352 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1740 microversion: 2.20 time: 0.305763 Jun 16 00:29:41.252445 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 148/306] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:40 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1740 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:29:41.295376 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-f7f3fc6d-d669-4ffc-a2eb-22f6cd4b9c3a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Flavor limits 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:29:41.295975 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-f7f3fc6d-d669-4ffc-a2eb-22f6cd4b9c3a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Image limits 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:29:41.296420 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-f7f3fc6d-d669-4ffc-a2eb-22f6cd4b9c3a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Flavor pref 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:29:41.297026 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-f7f3fc6d-d669-4ffc-a2eb-22f6cd4b9c3a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Image pref 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:29:41.297487 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-f7f3fc6d-d669-4ffc-a2eb-22f6cd4b9c3a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:29:41.326760 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f7f3fc6d-d669-4ffc-a2eb-22f6cd4b9c3a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:41.327777 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f7f3fc6d-d669-4ffc-a2eb-22f6cd4b9c3a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:41.329457 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f7f3fc6d-d669-4ffc-a2eb-22f6cd4b9c3a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:41.330070 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f7f3fc6d-d669-4ffc-a2eb-22f6cd4b9c3a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:41.354588 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-f7f3fc6d-d669-4ffc-a2eb-22f6cd4b9c3a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Getting quotas for project 0e5f17f8ba8e4113a27a004ebb29917a. Resources: {'ram', 'cores', 'instances'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:29:41.371128 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-f7f3fc6d-d669-4ffc-a2eb-22f6cd4b9c3a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Getting quotas for user b5f4125ecaec41e5ba5c4eaf00c43e07 and project 0e5f17f8ba8e4113a27a004ebb29917a. Resources: {'ram', 'cores', 'instances'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:29:41.405864 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-f7f3fc6d-d669-4ffc-a2eb-22f6cd4b9c3a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Going to run 1 instances... {{(pid=124231) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:29:41.412839 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-f7f3fc6d-d669-4ffc-a2eb-22f6cd4b9c3a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d9a6de24-7a5e-4f8b-b078-809c87b15d56',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:29:41.494069 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-f7f3fc6d-d669-4ffc-a2eb-22f6cd4b9c3a tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.259340 Jun 16 00:29:41.495708 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 159/307] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Jun 16 00:29:40 2022] POST /compute/v2.1/servers => generated 409 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 00:29:41.506805 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-07de69dc-147d-4db6-b403-58a04a303180 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:41.507814 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-07de69dc-147d-4db6-b403-58a04a303180 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:41.672829 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-07de69dc-147d-4db6-b403-58a04a303180 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:41.683229 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-07de69dc-147d-4db6-b403-58a04a303180 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1245 microversion: 2.1 time: 0.181409 Jun 16 00:29:41.688985 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 149/308] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:41 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1245 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:41.799063 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-65acba1b-7689-460d-848c-91808814d6de tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:41.799849 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-65acba1b-7689-460d-848c-91808814d6de tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 59e8ed9c-a1d0-4799-8602-3536fcb3e81f] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:41.819201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-65acba1b-7689-460d-848c-91808814d6de tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:41.820751 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-65acba1b-7689-460d-848c-91808814d6de tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:41.821814 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-65acba1b-7689-460d-848c-91808814d6de tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:41.822462 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-65acba1b-7689-460d-848c-91808814d6de tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:41.947793 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-65acba1b-7689-460d-848c-91808814d6de tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:41.963830 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-65acba1b-7689-460d-848c-91808814d6de tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f" status: 200 len: 1266 microversion: 2.1 time: 0.168956 Jun 16 00:29:41.973182 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 160/309] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:41 2022] GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:42.273533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-54980611-1701-4351-8e32-b3be29eb49d2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:42.275004 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-54980611-1701-4351-8e32-b3be29eb49d2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:42.295819 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-54980611-1701-4351-8e32-b3be29eb49d2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:42.296659 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-54980611-1701-4351-8e32-b3be29eb49d2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:42.297746 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-54980611-1701-4351-8e32-b3be29eb49d2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:42.298397 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-54980611-1701-4351-8e32-b3be29eb49d2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:42.618466 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-54980611-1701-4351-8e32-b3be29eb49d2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:42.630082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-54980611-1701-4351-8e32-b3be29eb49d2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:42.631727 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-54980611-1701-4351-8e32-b3be29eb49d2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:42.633023 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-54980611-1701-4351-8e32-b3be29eb49d2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1740 microversion: 2.20 time: 0.365978 Jun 16 00:29:42.643455 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 150/310] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:42 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1740 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:42.700947 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-60f7a678-d0de-49bb-b9fd-6e3a585b222d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:42.701687 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-60f7a678-d0de-49bb-b9fd-6e3a585b222d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:42.714341 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-60f7a678-d0de-49bb-b9fd-6e3a585b222d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:42.714883 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-60f7a678-d0de-49bb-b9fd-6e3a585b222d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:42.715859 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-60f7a678-d0de-49bb-b9fd-6e3a585b222d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:42.716389 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-60f7a678-d0de-49bb-b9fd-6e3a585b222d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:42.727721 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=100 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:42.799722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-60f7a678-d0de-49bb-b9fd-6e3a585b222d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:42.813838 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-60f7a678-d0de-49bb-b9fd-6e3a585b222d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1297 microversion: 2.1 time: 0.117228 Jun 16 00:29:42.814851 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 161/311] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:42 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1297 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:42.987198 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b6e416ab-d383-4b75-8820-a0e7344c29fd tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:42.988066 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-b6e416ab-d383-4b75-8820-a0e7344c29fd tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 59e8ed9c-a1d0-4799-8602-3536fcb3e81f] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:43.005179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b6e416ab-d383-4b75-8820-a0e7344c29fd tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:43.005725 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b6e416ab-d383-4b75-8820-a0e7344c29fd tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:43.011846 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b6e416ab-d383-4b75-8820-a0e7344c29fd tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:43.012784 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b6e416ab-d383-4b75-8820-a0e7344c29fd tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:43.210405 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b6e416ab-d383-4b75-8820-a0e7344c29fd tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:43.221515 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-b6e416ab-d383-4b75-8820-a0e7344c29fd tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f" status: 200 len: 1272 microversion: 2.1 time: 0.240733 Jun 16 00:29:43.222473 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 151/312] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:42 2022] GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f => generated 1272 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:43.652397 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-0b2aa25f-4dad-4067-bf1f-8a5123ff18d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:43.653417 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-0b2aa25f-4dad-4067-bf1f-8a5123ff18d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:43.660324 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0b2aa25f-4dad-4067-bf1f-8a5123ff18d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:43.661787 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0b2aa25f-4dad-4067-bf1f-8a5123ff18d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:43.663504 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0b2aa25f-4dad-4067-bf1f-8a5123ff18d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:43.664193 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0b2aa25f-4dad-4067-bf1f-8a5123ff18d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:43.832284 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-958305c4-b8c0-45f6-9371-e6a4e8ee7930 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:43.833620 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-958305c4-b8c0-45f6-9371-e6a4e8ee7930 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:43.845877 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-958305c4-b8c0-45f6-9371-e6a4e8ee7930 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:43.847674 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-958305c4-b8c0-45f6-9371-e6a4e8ee7930 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:43.849451 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-958305c4-b8c0-45f6-9371-e6a4e8ee7930 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:43.850906 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-958305c4-b8c0-45f6-9371-e6a4e8ee7930 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:43.877081 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-0b2aa25f-4dad-4067-bf1f-8a5123ff18d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:43.887451 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-0b2aa25f-4dad-4067-bf1f-8a5123ff18d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:43.890033 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-0b2aa25f-4dad-4067-bf1f-8a5123ff18d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:43.891378 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-0b2aa25f-4dad-4067-bf1f-8a5123ff18d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1740 microversion: 2.20 time: 0.243325 Jun 16 00:29:43.903916 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 162/313] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:43 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:43.978282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-958305c4-b8c0-45f6-9371-e6a4e8ee7930 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:44.004079 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-958305c4-b8c0-45f6-9371-e6a4e8ee7930 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1303 microversion: 2.1 time: 0.175490 Jun 16 00:29:44.013960 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 152/314] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:43 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1303 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:44.245590 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-1d5a1887-44e6-46d7-85d4-f6d6d7c90f9e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:44.246711 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-1d5a1887-44e6-46d7-85d4-f6d6d7c90f9e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 59e8ed9c-a1d0-4799-8602-3536fcb3e81f] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:44.267719 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1d5a1887-44e6-46d7-85d4-f6d6d7c90f9e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:44.270890 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1d5a1887-44e6-46d7-85d4-f6d6d7c90f9e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:44.273684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1d5a1887-44e6-46d7-85d4-f6d6d7c90f9e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:44.274783 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1d5a1887-44e6-46d7-85d4-f6d6d7c90f9e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:44.509358 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-1d5a1887-44e6-46d7-85d4-f6d6d7c90f9e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:44.521746 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-1d5a1887-44e6-46d7-85d4-f6d6d7c90f9e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f" status: 200 len: 1314 microversion: 2.1 time: 0.283155 Jun 16 00:29:44.522616 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 163/315] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:44 2022] GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:44.912692 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c3daf798-3e6c-4193-a740-f31b664465e6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:44.914215 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c3daf798-3e6c-4193-a740-f31b664465e6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:44.917344 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:44.926212 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c3daf798-3e6c-4193-a740-f31b664465e6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:44.928382 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c3daf798-3e6c-4193-a740-f31b664465e6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:44.929464 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c3daf798-3e6c-4193-a740-f31b664465e6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:44.930051 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c3daf798-3e6c-4193-a740-f31b664465e6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:45.025641 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-6daaec8a-91b9-4843-98e3-a0ef4b97fce6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:45.027759 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-6daaec8a-91b9-4843-98e3-a0ef4b97fce6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:45.036558 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6daaec8a-91b9-4843-98e3-a0ef4b97fce6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:45.042108 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6daaec8a-91b9-4843-98e3-a0ef4b97fce6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:45.042108 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6daaec8a-91b9-4843-98e3-a0ef4b97fce6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:45.042108 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6daaec8a-91b9-4843-98e3-a0ef4b97fce6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:45.267255 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-6daaec8a-91b9-4843-98e3-a0ef4b97fce6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:45.278573 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-6daaec8a-91b9-4843-98e3-a0ef4b97fce6 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1371 microversion: 2.1 time: 0.261063 Jun 16 00:29:45.289281 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 164/316] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:45 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1371 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:45.295034 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-be41566d-1467-40b1-ad31-ff29732179cb req-7468f23e-c724-4ac1-86a9-b735ced8801d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59e8ed9c-a1d0-4799-8602-3536fcb3e81f", "tag": "8ff22bd5-a74f-411b-8716-1856d70849df"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:29:45.321081 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-be41566d-1467-40b1-ad31-ff29732179cb req-7468f23e-c724-4ac1-86a9-b735ced8801d service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:45.323379 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-be41566d-1467-40b1-ad31-ff29732179cb req-7468f23e-c724-4ac1-86a9-b735ced8801d service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:45.353296 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-be41566d-1467-40b1-ad31-ff29732179cb req-7468f23e-c724-4ac1-86a9-b735ced8801d service nova] Creating event network-changed:8ff22bd5-a74f-411b-8716-1856d70849df for instance 59e8ed9c-a1d0-4799-8602-3536fcb3e81f on hv-cinder-84599 Jun 16 00:29:45.359728 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-be41566d-1467-40b1-ad31-ff29732179cb req-7468f23e-c724-4ac1-86a9-b735ced8801d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068303 Jun 16 00:29:45.360974 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 165/317] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:29:45.541225 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-38d9924b-7a8f-4e65-81e6-61303b71182a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:45.542279 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-38d9924b-7a8f-4e65-81e6-61303b71182a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 59e8ed9c-a1d0-4799-8602-3536fcb3e81f] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:45.549995 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-38d9924b-7a8f-4e65-81e6-61303b71182a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:45.550839 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-38d9924b-7a8f-4e65-81e6-61303b71182a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:45.552293 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-38d9924b-7a8f-4e65-81e6-61303b71182a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:45.552918 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-38d9924b-7a8f-4e65-81e6-61303b71182a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:45.648768 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c3daf798-3e6c-4193-a740-f31b664465e6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:45.664388 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c3daf798-3e6c-4193-a740-f31b664465e6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:45.666084 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c3daf798-3e6c-4193-a740-f31b664465e6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:45.667276 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c3daf798-3e6c-4193-a740-f31b664465e6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1740 microversion: 2.20 time: 0.759230 Jun 16 00:29:45.668281 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 153/318] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:44 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1740 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:45.715855 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-38d9924b-7a8f-4e65-81e6-61303b71182a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:45.724598 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-38d9924b-7a8f-4e65-81e6-61303b71182a tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f" status: 200 len: 1314 microversion: 2.1 time: 0.188925 Jun 16 00:29:45.732947 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 166/319] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:45 2022] GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:46.295564 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d5c875a3-622a-49e5-870b-11bfbcfe1f90 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:46.296181 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d5c875a3-622a-49e5-870b-11bfbcfe1f90 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:46.312447 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d5c875a3-622a-49e5-870b-11bfbcfe1f90 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:46.320303 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d5c875a3-622a-49e5-870b-11bfbcfe1f90 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:46.321426 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d5c875a3-622a-49e5-870b-11bfbcfe1f90 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:46.322023 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d5c875a3-622a-49e5-870b-11bfbcfe1f90 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:46.488465 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d5c875a3-622a-49e5-870b-11bfbcfe1f90 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:46.501054 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d5c875a3-622a-49e5-870b-11bfbcfe1f90 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1371 microversion: 2.1 time: 0.209186 Jun 16 00:29:46.510527 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 154/320] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:46 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:46.687759 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-9695c864-570a-4a22-b645-c4b550cd26a7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:46.688975 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-9695c864-570a-4a22-b645-c4b550cd26a7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:46.696242 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9695c864-570a-4a22-b645-c4b550cd26a7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:46.696612 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9695c864-570a-4a22-b645-c4b550cd26a7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:46.697397 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9695c864-570a-4a22-b645-c4b550cd26a7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:46.697833 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9695c864-570a-4a22-b645-c4b550cd26a7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:46.742087 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-7623b93d-523e-4c8a-8ccf-b2068d24243b tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:46.742770 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-7623b93d-523e-4c8a-8ccf-b2068d24243b tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 59e8ed9c-a1d0-4799-8602-3536fcb3e81f] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:46.749168 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7623b93d-523e-4c8a-8ccf-b2068d24243b tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:46.749611 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7623b93d-523e-4c8a-8ccf-b2068d24243b tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:46.750375 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7623b93d-523e-4c8a-8ccf-b2068d24243b tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:46.750801 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7623b93d-523e-4c8a-8ccf-b2068d24243b tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:46.873115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-9695c864-570a-4a22-b645-c4b550cd26a7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:46.885679 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-9695c864-570a-4a22-b645-c4b550cd26a7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:46.887632 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-9695c864-570a-4a22-b645-c4b550cd26a7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:46.888790 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-9695c864-570a-4a22-b645-c4b550cd26a7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1740 microversion: 2.20 time: 0.206349 Jun 16 00:29:46.903453 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 167/321] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:46 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:46.922280 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-7623b93d-523e-4c8a-8ccf-b2068d24243b tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:46.932141 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-7623b93d-523e-4c8a-8ccf-b2068d24243b tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f" status: 200 len: 1314 microversion: 2.1 time: 0.194617 Jun 16 00:29:46.942526 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 155/322] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:46 2022] GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:47.382630 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-b495ec5e-5993-42fb-b468-bb753f02618a req-60c166e5-67d5-49f5-a5f7-32cf2491c8ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8298735b-2311-40d2-9261-ba64afe3b7fe", "tag": "c5105353-b394-4e1d-81d1-b94b0637e747"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:29:47.397253 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-b495ec5e-5993-42fb-b468-bb753f02618a req-60c166e5-67d5-49f5-a5f7-32cf2491c8ca service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:47.397817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-b495ec5e-5993-42fb-b468-bb753f02618a req-60c166e5-67d5-49f5-a5f7-32cf2491c8ca service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:47.409977 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-b495ec5e-5993-42fb-b468-bb753f02618a req-60c166e5-67d5-49f5-a5f7-32cf2491c8ca service nova] Creating event network-changed:c5105353-b394-4e1d-81d1-b94b0637e747 for instance 8298735b-2311-40d2-9261-ba64afe3b7fe on hv-cinder-84599 Jun 16 00:29:47.415850 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-b495ec5e-5993-42fb-b468-bb753f02618a req-60c166e5-67d5-49f5-a5f7-32cf2491c8ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036642 Jun 16 00:29:47.417088 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 168/323] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:29:47.517820 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-175ed605-310b-4b24-8d3e-1f368f0c4ff9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:47.519274 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-175ed605-310b-4b24-8d3e-1f368f0c4ff9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:47.528308 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-175ed605-310b-4b24-8d3e-1f368f0c4ff9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:47.529512 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-175ed605-310b-4b24-8d3e-1f368f0c4ff9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:47.530312 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-175ed605-310b-4b24-8d3e-1f368f0c4ff9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:47.530752 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-175ed605-310b-4b24-8d3e-1f368f0c4ff9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:47.857002 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-175ed605-310b-4b24-8d3e-1f368f0c4ff9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:47.865042 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-175ed605-310b-4b24-8d3e-1f368f0c4ff9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1371 microversion: 2.1 time: 0.350929 Jun 16 00:29:47.865765 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 156/324] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:47 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1371 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:47.907947 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b8a65684-e102-4cfe-8784-49410723b783 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:47.908712 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-b8a65684-e102-4cfe-8784-49410723b783 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:47.915237 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b8a65684-e102-4cfe-8784-49410723b783 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:47.915774 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b8a65684-e102-4cfe-8784-49410723b783 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:47.916606 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b8a65684-e102-4cfe-8784-49410723b783 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:47.917066 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b8a65684-e102-4cfe-8784-49410723b783 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:47.960066 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-0e005b25-0ad7-4aff-bbdf-8f1c9f082e31 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:47.961110 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-0e005b25-0ad7-4aff-bbdf-8f1c9f082e31 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 59e8ed9c-a1d0-4799-8602-3536fcb3e81f] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:47.976504 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0e005b25-0ad7-4aff-bbdf-8f1c9f082e31 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:47.977048 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0e005b25-0ad7-4aff-bbdf-8f1c9f082e31 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:47.977810 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0e005b25-0ad7-4aff-bbdf-8f1c9f082e31 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:47.978234 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0e005b25-0ad7-4aff-bbdf-8f1c9f082e31 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:48.062116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-b8a65684-e102-4cfe-8784-49410723b783 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:48.071487 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-b8a65684-e102-4cfe-8784-49410723b783 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:48.073123 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-b8a65684-e102-4cfe-8784-49410723b783 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:48.074324 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-b8a65684-e102-4cfe-8784-49410723b783 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1740 microversion: 2.20 time: 0.170877 Jun 16 00:29:48.074860 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 169/325] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:47 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:48.306502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0e005b25-0ad7-4aff-bbdf-8f1c9f082e31 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:48.316654 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-0e005b25-0ad7-4aff-bbdf-8f1c9f082e31 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f" status: 200 len: 1314 microversion: 2.1 time: 0.370256 Jun 16 00:29:48.317542 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 157/326] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:47 2022] GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:48.882400 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-e3f34dc4-039e-4f03-9c19-21bed6e40aeb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:48.882912 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-e3f34dc4-039e-4f03-9c19-21bed6e40aeb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:48.889019 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e3f34dc4-039e-4f03-9c19-21bed6e40aeb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:48.889465 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e3f34dc4-039e-4f03-9c19-21bed6e40aeb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:48.890212 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e3f34dc4-039e-4f03-9c19-21bed6e40aeb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:48.890641 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e3f34dc4-039e-4f03-9c19-21bed6e40aeb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:49.044945 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-e3f34dc4-039e-4f03-9c19-21bed6e40aeb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:49.058427 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-e3f34dc4-039e-4f03-9c19-21bed6e40aeb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1371 microversion: 2.1 time: 0.180135 Jun 16 00:29:49.059287 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 170/327] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:48 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:49.093407 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-e798def3-fe20-4ca3-8288-e635528e1a07 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:49.094904 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-e798def3-fe20-4ca3-8288-e635528e1a07 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:49.105514 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e798def3-fe20-4ca3-8288-e635528e1a07 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:49.106039 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e798def3-fe20-4ca3-8288-e635528e1a07 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:49.107378 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e798def3-fe20-4ca3-8288-e635528e1a07 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:49.108130 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e798def3-fe20-4ca3-8288-e635528e1a07 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:49.299782 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-e798def3-fe20-4ca3-8288-e635528e1a07 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:49.335706 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-988109a6-9484-43ff-892d-3d0184fcfbf5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:49.336992 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-988109a6-9484-43ff-892d-3d0184fcfbf5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 59e8ed9c-a1d0-4799-8602-3536fcb3e81f] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:49.344107 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-988109a6-9484-43ff-892d-3d0184fcfbf5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:49.344730 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-988109a6-9484-43ff-892d-3d0184fcfbf5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:49.345732 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-988109a6-9484-43ff-892d-3d0184fcfbf5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:49.346159 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-988109a6-9484-43ff-892d-3d0184fcfbf5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:49.370087 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-e798def3-fe20-4ca3-8288-e635528e1a07 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:49.371651 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-e798def3-fe20-4ca3-8288-e635528e1a07 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:49.372916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-e798def3-fe20-4ca3-8288-e635528e1a07 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1740 microversion: 2.20 time: 0.284657 Jun 16 00:29:49.385293 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 158/328] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:49 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1740 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:49.495632 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-988109a6-9484-43ff-892d-3d0184fcfbf5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:49.503141 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-988109a6-9484-43ff-892d-3d0184fcfbf5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f" status: 200 len: 1314 microversion: 2.1 time: 0.172798 Jun 16 00:29:49.512325 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 171/329] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:49 2022] GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:50.095267 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-a39502c2-1994-439e-9084-52720bebf827 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:50.096037 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-a39502c2-1994-439e-9084-52720bebf827 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:50.103187 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a39502c2-1994-439e-9084-52720bebf827 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:50.103642 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a39502c2-1994-439e-9084-52720bebf827 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:50.104422 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a39502c2-1994-439e-9084-52720bebf827 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:50.104861 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a39502c2-1994-439e-9084-52720bebf827 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:50.257098 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a39502c2-1994-439e-9084-52720bebf827 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:50.265322 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-a39502c2-1994-439e-9084-52720bebf827 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1371 microversion: 2.1 time: 0.176677 Jun 16 00:29:50.265966 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 159/330] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:50 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:50.393649 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-65daa398-1182-4b16-b712-7236edf23a5d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:50.394321 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-65daa398-1182-4b16-b712-7236edf23a5d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:50.400971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-65daa398-1182-4b16-b712-7236edf23a5d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:50.401753 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-65daa398-1182-4b16-b712-7236edf23a5d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:50.402492 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-65daa398-1182-4b16-b712-7236edf23a5d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:50.402918 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-65daa398-1182-4b16-b712-7236edf23a5d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:50.522677 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d39ea589-6dd9-4888-b04d-a6ecaef1a2d5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:50.523561 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d39ea589-6dd9-4888-b04d-a6ecaef1a2d5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 59e8ed9c-a1d0-4799-8602-3536fcb3e81f] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:50.535525 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d39ea589-6dd9-4888-b04d-a6ecaef1a2d5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:50.536145 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d39ea589-6dd9-4888-b04d-a6ecaef1a2d5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:50.537132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d39ea589-6dd9-4888-b04d-a6ecaef1a2d5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:50.537768 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d39ea589-6dd9-4888-b04d-a6ecaef1a2d5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:50.582574 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=2 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:50.588666 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-65daa398-1182-4b16-b712-7236edf23a5d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:50.597414 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-65daa398-1182-4b16-b712-7236edf23a5d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:50.599062 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-65daa398-1182-4b16-b712-7236edf23a5d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:50.600462 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-65daa398-1182-4b16-b712-7236edf23a5d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1740 microversion: 2.20 time: 0.211298 Jun 16 00:29:50.601116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 172/331] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:50 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:29:50.681599 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d39ea589-6dd9-4888-b04d-a6ecaef1a2d5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:50.690456 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d39ea589-6dd9-4888-b04d-a6ecaef1a2d5 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f" status: 200 len: 1314 microversion: 2.1 time: 0.174726 Jun 16 00:29:50.692541 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 160/332] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:50 2022] GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:51.213447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-6d525bbc-c820-41ea-8a84-7cc8b49c5b53 req-72a44ced-0bdd-4f53-b875-5328f5519f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e8ed9c-a1d0-4799-8602-3536fcb3e81f", "name": "network-vif-plugged", "status": "completed", "tag": "8ff22bd5-a74f-411b-8716-1856d70849df"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:29:51.225612 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-6d525bbc-c820-41ea-8a84-7cc8b49c5b53 req-72a44ced-0bdd-4f53-b875-5328f5519f2a service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:51.226274 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-6d525bbc-c820-41ea-8a84-7cc8b49c5b53 req-72a44ced-0bdd-4f53-b875-5328f5519f2a service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:51.240184 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-6d525bbc-c820-41ea-8a84-7cc8b49c5b53 req-72a44ced-0bdd-4f53-b875-5328f5519f2a service nova] Creating event network-vif-plugged:8ff22bd5-a74f-411b-8716-1856d70849df for instance 59e8ed9c-a1d0-4799-8602-3536fcb3e81f on hv-cinder-84599 Jun 16 00:29:51.245719 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-6d525bbc-c820-41ea-8a84-7cc8b49c5b53 req-72a44ced-0bdd-4f53-b875-5328f5519f2a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036907 Jun 16 00:29:51.246940 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 173/333] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:29:51.283633 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-0db02084-9ee3-41a2-810f-419c399bf4e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:51.284341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-0db02084-9ee3-41a2-810f-419c399bf4e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:51.298845 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0db02084-9ee3-41a2-810f-419c399bf4e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:51.299787 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0db02084-9ee3-41a2-810f-419c399bf4e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:51.300593 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0db02084-9ee3-41a2-810f-419c399bf4e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:51.301074 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0db02084-9ee3-41a2-810f-419c399bf4e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:51.579452 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0db02084-9ee3-41a2-810f-419c399bf4e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:51.589548 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-0db02084-9ee3-41a2-810f-419c399bf4e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1371 microversion: 2.1 time: 0.310491 Jun 16 00:29:51.590387 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 161/334] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:51 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1371 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:51.619863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-7d9a167f-e6be-4509-bfdc-2f2d54fb55df tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:51.620688 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-7d9a167f-e6be-4509-bfdc-2f2d54fb55df tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:51.622719 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=2 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:51.623781 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=10 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:51.632486 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7d9a167f-e6be-4509-bfdc-2f2d54fb55df tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:51.632833 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7d9a167f-e6be-4509-bfdc-2f2d54fb55df tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:51.633662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7d9a167f-e6be-4509-bfdc-2f2d54fb55df tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:51.634094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7d9a167f-e6be-4509-bfdc-2f2d54fb55df tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:51.713601 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-94007933-dbde-4642-b07e-d0c3bebd99a0 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:51.714565 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-94007933-dbde-4642-b07e-d0c3bebd99a0 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 59e8ed9c-a1d0-4799-8602-3536fcb3e81f] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:51.716688 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=10 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:51.723346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-94007933-dbde-4642-b07e-d0c3bebd99a0 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:51.724129 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-94007933-dbde-4642-b07e-d0c3bebd99a0 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:51.725165 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-94007933-dbde-4642-b07e-d0c3bebd99a0 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:51.726298 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-94007933-dbde-4642-b07e-d0c3bebd99a0 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:51.803374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-7d9a167f-e6be-4509-bfdc-2f2d54fb55df tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:51.819560 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-7d9a167f-e6be-4509-bfdc-2f2d54fb55df tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:51.826513 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-7d9a167f-e6be-4509-bfdc-2f2d54fb55df tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:51.827961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-7d9a167f-e6be-4509-bfdc-2f2d54fb55df tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1740 microversion: 2.20 time: 0.212281 Jun 16 00:29:51.829026 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 174/335] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:51 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:51.900617 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-94007933-dbde-4642-b07e-d0c3bebd99a0 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:51.908429 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-94007933-dbde-4642-b07e-d0c3bebd99a0 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f" status: 200 len: 1314 microversion: 2.1 time: 0.198630 Jun 16 00:29:51.909063 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 162/336] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:51 2022] GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:52.606825 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-586a1bce-1dff-4f35-912b-9c4eda926ce0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:52.607434 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-586a1bce-1dff-4f35-912b-9c4eda926ce0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:52.614949 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-586a1bce-1dff-4f35-912b-9c4eda926ce0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:52.615404 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-586a1bce-1dff-4f35-912b-9c4eda926ce0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:52.616680 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-586a1bce-1dff-4f35-912b-9c4eda926ce0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:52.617238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-586a1bce-1dff-4f35-912b-9c4eda926ce0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:52.802567 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-586a1bce-1dff-4f35-912b-9c4eda926ce0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:52.814334 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-586a1bce-1dff-4f35-912b-9c4eda926ce0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1371 microversion: 2.1 time: 0.211181 Jun 16 00:29:52.815981 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 175/337] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:52 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:52.848926 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-00318105-e13b-4311-892c-eb8fda75dc5f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:52.852114 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-00318105-e13b-4311-892c-eb8fda75dc5f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:52.860353 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-00318105-e13b-4311-892c-eb8fda75dc5f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:52.861177 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-00318105-e13b-4311-892c-eb8fda75dc5f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:52.862825 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-00318105-e13b-4311-892c-eb8fda75dc5f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:52.863447 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-00318105-e13b-4311-892c-eb8fda75dc5f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:52.930634 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-a1a69cb8-c161-4c6f-b925-18e40c322a76 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:52.931320 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-a1a69cb8-c161-4c6f-b925-18e40c322a76 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 59e8ed9c-a1d0-4799-8602-3536fcb3e81f] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:52.945545 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a1a69cb8-c161-4c6f-b925-18e40c322a76 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:52.946292 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a1a69cb8-c161-4c6f-b925-18e40c322a76 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:52.950344 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a1a69cb8-c161-4c6f-b925-18e40c322a76 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:52.951247 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a1a69cb8-c161-4c6f-b925-18e40c322a76 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:53.172667 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-00318105-e13b-4311-892c-eb8fda75dc5f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:53.175883 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-a1a69cb8-c161-4c6f-b925-18e40c322a76 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:53.184000 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-00318105-e13b-4311-892c-eb8fda75dc5f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:53.185889 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-00318105-e13b-4311-892c-eb8fda75dc5f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:53.187326 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-00318105-e13b-4311-892c-eb8fda75dc5f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1740 microversion: 2.20 time: 0.344646 Jun 16 00:29:53.187970 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 163/338] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:52 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1740 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:53.198571 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-a1a69cb8-c161-4c6f-b925-18e40c322a76 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f" status: 200 len: 1314 microversion: 2.1 time: 0.268219 Jun 16 00:29:53.198571 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 176/339] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:52 2022] GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:53.833427 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-f6fc5f50-b16a-4461-b3df-b038ce545988 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:53.834037 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-f6fc5f50-b16a-4461-b3df-b038ce545988 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:53.840038 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f6fc5f50-b16a-4461-b3df-b038ce545988 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:53.840484 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f6fc5f50-b16a-4461-b3df-b038ce545988 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:53.841266 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f6fc5f50-b16a-4461-b3df-b038ce545988 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:53.841695 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f6fc5f50-b16a-4461-b3df-b038ce545988 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:53.859608 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=100 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:53.978017 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f6fc5f50-b16a-4461-b3df-b038ce545988 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:53.985427 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-f6fc5f50-b16a-4461-b3df-b038ce545988 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1371 microversion: 2.1 time: 0.156312 Jun 16 00:29:53.985986 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 164/340] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:53 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:54.206971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-aa1532c9-e2aa-40bf-9a62-72096d0ce4a2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:54.207660 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-aa1532c9-e2aa-40bf-9a62-72096d0ce4a2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:54.212096 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-867daa69-4b65-4ac6-b310-4cb1c616bcda tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:54.212848 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-867daa69-4b65-4ac6-b310-4cb1c616bcda tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 59e8ed9c-a1d0-4799-8602-3536fcb3e81f] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:54.215821 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-aa1532c9-e2aa-40bf-9a62-72096d0ce4a2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:54.216404 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-aa1532c9-e2aa-40bf-9a62-72096d0ce4a2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:54.217287 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-aa1532c9-e2aa-40bf-9a62-72096d0ce4a2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:54.217727 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-aa1532c9-e2aa-40bf-9a62-72096d0ce4a2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:54.219961 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-867daa69-4b65-4ac6-b310-4cb1c616bcda tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:54.220709 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-867daa69-4b65-4ac6-b310-4cb1c616bcda tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:54.221650 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-867daa69-4b65-4ac6-b310-4cb1c616bcda tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:54.222088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-867daa69-4b65-4ac6-b310-4cb1c616bcda tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:54.360791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-867daa69-4b65-4ac6-b310-4cb1c616bcda tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:54.362404 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-aa1532c9-e2aa-40bf-9a62-72096d0ce4a2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:54.369342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-867daa69-4b65-4ac6-b310-4cb1c616bcda tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f" status: 200 len: 1498 microversion: 2.1 time: 0.161549 Jun 16 00:29:54.370152 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 165/341] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:54 2022] GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:54.371013 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-aa1532c9-e2aa-40bf-9a62-72096d0ce4a2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:54.372509 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-aa1532c9-e2aa-40bf-9a62-72096d0ce4a2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:54.373680 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-aa1532c9-e2aa-40bf-9a62-72096d0ce4a2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1740 microversion: 2.20 time: 0.171608 Jun 16 00:29:54.374222 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 177/342] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:54 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:29:55.003209 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-669359ee-6a8b-4dbd-a78a-f258580285a5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:55.003752 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-669359ee-6a8b-4dbd-a78a-f258580285a5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:55.010589 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-669359ee-6a8b-4dbd-a78a-f258580285a5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:55.011033 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-669359ee-6a8b-4dbd-a78a-f258580285a5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:55.011783 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-669359ee-6a8b-4dbd-a78a-f258580285a5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:55.012211 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-669359ee-6a8b-4dbd-a78a-f258580285a5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:55.142416 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-669359ee-6a8b-4dbd-a78a-f258580285a5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:55.150166 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-669359ee-6a8b-4dbd-a78a-f258580285a5 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1371 microversion: 2.1 time: 0.150873 Jun 16 00:29:55.150730 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 166/343] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:54 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:55.391131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-bc3c0b44-da61-4cd8-9d99-e0919019e9e8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:55.391748 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-bc3c0b44-da61-4cd8-9d99-e0919019e9e8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:55.398559 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-bc3c0b44-da61-4cd8-9d99-e0919019e9e8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:55.398996 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-bc3c0b44-da61-4cd8-9d99-e0919019e9e8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:55.399733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-bc3c0b44-da61-4cd8-9d99-e0919019e9e8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:55.400161 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-bc3c0b44-da61-4cd8-9d99-e0919019e9e8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:55.536484 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-bc3c0b44-da61-4cd8-9d99-e0919019e9e8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:55.544386 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-bc3c0b44-da61-4cd8-9d99-e0919019e9e8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:55.545890 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-bc3c0b44-da61-4cd8-9d99-e0919019e9e8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:55.547020 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-bc3c0b44-da61-4cd8-9d99-e0919019e9e8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1740 microversion: 2.20 time: 0.159793 Jun 16 00:29:55.547570 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 178/344] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:55 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:56.167447 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-397091bd-7cf4-48fb-97e2-1e6e5972cb01 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:56.168075 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-397091bd-7cf4-48fb-97e2-1e6e5972cb01 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:56.174468 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-397091bd-7cf4-48fb-97e2-1e6e5972cb01 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:56.174905 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-397091bd-7cf4-48fb-97e2-1e6e5972cb01 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:56.175646 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-397091bd-7cf4-48fb-97e2-1e6e5972cb01 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:56.176071 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-397091bd-7cf4-48fb-97e2-1e6e5972cb01 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:56.316519 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-397091bd-7cf4-48fb-97e2-1e6e5972cb01 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:56.326868 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-397091bd-7cf4-48fb-97e2-1e6e5972cb01 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1371 microversion: 2.1 time: 0.163042 Jun 16 00:29:56.327508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 167/345] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:56 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:56.565519 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-3973723e-486c-4856-8abc-e8066e091ae7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:56.567448 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-3973723e-486c-4856-8abc-e8066e091ae7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:56.574052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3973723e-486c-4856-8abc-e8066e091ae7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:56.574504 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3973723e-486c-4856-8abc-e8066e091ae7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:56.575264 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3973723e-486c-4856-8abc-e8066e091ae7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:56.575690 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3973723e-486c-4856-8abc-e8066e091ae7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:56.705013 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-3973723e-486c-4856-8abc-e8066e091ae7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:56.708991 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=100 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:56.714838 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-3973723e-486c-4856-8abc-e8066e091ae7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:56.716339 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-3973723e-486c-4856-8abc-e8066e091ae7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:56.717495 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-3973723e-486c-4856-8abc-e8066e091ae7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1740 microversion: 2.20 time: 0.156110 Jun 16 00:29:56.718038 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 179/346] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:56 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:57.343564 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-eaea3428-98ba-478a-beca-a30611cc8b90 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:57.344197 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-eaea3428-98ba-478a-beca-a30611cc8b90 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:57.351303 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-eaea3428-98ba-478a-beca-a30611cc8b90 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:57.351754 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-eaea3428-98ba-478a-beca-a30611cc8b90 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:57.352519 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-eaea3428-98ba-478a-beca-a30611cc8b90 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:57.352980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-eaea3428-98ba-478a-beca-a30611cc8b90 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:57.575007 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-eaea3428-98ba-478a-beca-a30611cc8b90 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:57.583114 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-eaea3428-98ba-478a-beca-a30611cc8b90 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1371 microversion: 2.1 time: 0.242860 Jun 16 00:29:57.584268 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 168/347] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:57 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:57.697452 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-4fa382da-7c6c-42a8-a2a9-86be2265f394 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:57.697955 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-4fa382da-7c6c-42a8-a2a9-86be2265f394 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 59e8ed9c-a1d0-4799-8602-3536fcb3e81f] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:57.704125 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4fa382da-7c6c-42a8-a2a9-86be2265f394 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:57.704576 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4fa382da-7c6c-42a8-a2a9-86be2265f394 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:57.705418 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4fa382da-7c6c-42a8-a2a9-86be2265f394 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:57.705891 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4fa382da-7c6c-42a8-a2a9-86be2265f394 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:57.736025 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b5fc1ba9-aa75-4fe8-bb9f-62d928e65788 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:57.736707 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-b5fc1ba9-aa75-4fe8-bb9f-62d928e65788 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:57.737213 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-4fa382da-7c6c-42a8-a2a9-86be2265f394 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 59e8ed9c-a1d0-4799-8602-3536fcb3e81f] Going to try to terminate instance {{(pid=124231) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:29:57.743028 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b5fc1ba9-aa75-4fe8-bb9f-62d928e65788 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:57.743496 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b5fc1ba9-aa75-4fe8-bb9f-62d928e65788 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:57.744250 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b5fc1ba9-aa75-4fe8-bb9f-62d928e65788 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:57.744719 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b5fc1ba9-aa75-4fe8-bb9f-62d928e65788 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:57.821468 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-4fa382da-7c6c-42a8-a2a9-86be2265f394 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "DELETE /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f" status: 204 len: 0 microversion: 2.1 time: 0.127435 Jun 16 00:29:57.823338 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 180/348] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:29:57 2022] DELETE /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:29:57.831585 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-8286addd-2d83-40bd-aaad-13e47ea3daeb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:57.832289 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-8286addd-2d83-40bd-aaad-13e47ea3daeb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 59e8ed9c-a1d0-4799-8602-3536fcb3e81f] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:57.838892 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8286addd-2d83-40bd-aaad-13e47ea3daeb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:57.839380 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8286addd-2d83-40bd-aaad-13e47ea3daeb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:57.840448 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8286addd-2d83-40bd-aaad-13e47ea3daeb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:57.841299 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8286addd-2d83-40bd-aaad-13e47ea3daeb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:57.906856 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b5fc1ba9-aa75-4fe8-bb9f-62d928e65788 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:57.918252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b5fc1ba9-aa75-4fe8-bb9f-62d928e65788 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:57.920126 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b5fc1ba9-aa75-4fe8-bb9f-62d928e65788 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:57.921792 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-b5fc1ba9-aa75-4fe8-bb9f-62d928e65788 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1722 microversion: 2.20 time: 0.190180 Jun 16 00:29:57.922669 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 169/349] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:57 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:29:57.993172 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-8286addd-2d83-40bd-aaad-13e47ea3daeb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:58.000831 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-8286addd-2d83-40bd-aaad-13e47ea3daeb tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f" status: 200 len: 1504 microversion: 2.1 time: 0.173362 Jun 16 00:29:58.001452 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 181/350] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:57 2022] GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:58.476280 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-b2e22b40-fb56-4449-905c-5f1a8a3d0f19 req-95f1eada-3c13-4bf8-8720-57ca6a1fe96c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8298735b-2311-40d2-9261-ba64afe3b7fe", "name": "network-vif-plugged", "status": "completed", "tag": "c5105353-b394-4e1d-81d1-b94b0637e747"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:29:58.487630 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-b2e22b40-fb56-4449-905c-5f1a8a3d0f19 req-95f1eada-3c13-4bf8-8720-57ca6a1fe96c service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:58.488191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-b2e22b40-fb56-4449-905c-5f1a8a3d0f19 req-95f1eada-3c13-4bf8-8720-57ca6a1fe96c service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:58.500132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-b2e22b40-fb56-4449-905c-5f1a8a3d0f19 req-95f1eada-3c13-4bf8-8720-57ca6a1fe96c service nova] Creating event network-vif-plugged:c5105353-b394-4e1d-81d1-b94b0637e747 for instance 8298735b-2311-40d2-9261-ba64afe3b7fe on hv-cinder-84599 Jun 16 00:29:58.506224 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-b2e22b40-fb56-4449-905c-5f1a8a3d0f19 req-95f1eada-3c13-4bf8-8720-57ca6a1fe96c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036419 Jun 16 00:29:58.507074 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 170/351] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:29:58.601163 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-689396a7-ec24-424e-8dd7-bb00dcdad572 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:58.601881 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-689396a7-ec24-424e-8dd7-bb00dcdad572 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:58.608219 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-689396a7-ec24-424e-8dd7-bb00dcdad572 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:58.608731 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-689396a7-ec24-424e-8dd7-bb00dcdad572 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:58.609676 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-689396a7-ec24-424e-8dd7-bb00dcdad572 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:58.610287 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-689396a7-ec24-424e-8dd7-bb00dcdad572 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:58.766829 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-689396a7-ec24-424e-8dd7-bb00dcdad572 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:58.776479 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-689396a7-ec24-424e-8dd7-bb00dcdad572 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1371 microversion: 2.1 time: 0.179666 Jun 16 00:29:58.777442 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 182/352] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:58 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:58.942404 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-af035071-b153-47df-858c-6b8e372f177d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:58.943016 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-af035071-b153-47df-858c-6b8e372f177d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:58.949182 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-af035071-b153-47df-858c-6b8e372f177d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:58.949623 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-af035071-b153-47df-858c-6b8e372f177d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:58.950368 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-af035071-b153-47df-858c-6b8e372f177d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:58.950801 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-af035071-b153-47df-858c-6b8e372f177d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:59.024516 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-32847a0e-b4d7-4e98-a955-b6f55f9b017e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:59.025644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-32847a0e-b4d7-4e98-a955-b6f55f9b017e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 59e8ed9c-a1d0-4799-8602-3536fcb3e81f] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:59.035399 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-32847a0e-b4d7-4e98-a955-b6f55f9b017e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:59.036164 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-32847a0e-b4d7-4e98-a955-b6f55f9b017e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:59.037324 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-32847a0e-b4d7-4e98-a955-b6f55f9b017e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:59.037954 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-32847a0e-b4d7-4e98-a955-b6f55f9b017e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:59.121470 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-af035071-b153-47df-858c-6b8e372f177d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:59.131396 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-af035071-b153-47df-858c-6b8e372f177d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:59.132898 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-af035071-b153-47df-858c-6b8e372f177d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:59.134126 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-af035071-b153-47df-858c-6b8e372f177d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1722 microversion: 2.20 time: 0.196733 Jun 16 00:29:59.134975 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 171/353] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:29:58 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:59.181394 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-32847a0e-b4d7-4e98-a955-b6f55f9b017e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:59.188680 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-32847a0e-b4d7-4e98-a955-b6f55f9b017e tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f" status: 200 len: 1504 microversion: 2.1 time: 0.172755 Jun 16 00:29:59.189267 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 183/354] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:59 2022] GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:59.794215 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-0d47df0c-3610-479a-b700-fc248b19a9ce tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:59.794931 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-0d47df0c-3610-479a-b700-fc248b19a9ce tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:59.802238 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0d47df0c-3610-479a-b700-fc248b19a9ce tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:59.802889 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0d47df0c-3610-479a-b700-fc248b19a9ce tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:59.803745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0d47df0c-3610-479a-b700-fc248b19a9ce tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:59.804293 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0d47df0c-3610-479a-b700-fc248b19a9ce tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:59.943421 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0d47df0c-3610-479a-b700-fc248b19a9ce tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:59.951214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-0d47df0c-3610-479a-b700-fc248b19a9ce tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1371 microversion: 2.1 time: 0.161471 Jun 16 00:29:59.952918 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 172/355] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:59 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:00.152422 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-f70ddc35-69fa-4aa1-be27-1d9af59e308b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:00.153306 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-f70ddc35-69fa-4aa1-be27-1d9af59e308b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:00.159322 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f70ddc35-69fa-4aa1-be27-1d9af59e308b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:00.159829 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f70ddc35-69fa-4aa1-be27-1d9af59e308b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:00.161262 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f70ddc35-69fa-4aa1-be27-1d9af59e308b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:00.161783 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f70ddc35-69fa-4aa1-be27-1d9af59e308b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:00.206889 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d0569591-54b0-4b9c-971c-3c0c929f9494 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:00.209052 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d0569591-54b0-4b9c-971c-3c0c929f9494 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 59e8ed9c-a1d0-4799-8602-3536fcb3e81f] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:00.216394 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d0569591-54b0-4b9c-971c-3c0c929f9494 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:00.217202 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d0569591-54b0-4b9c-971c-3c0c929f9494 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:00.218174 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d0569591-54b0-4b9c-971c-3c0c929f9494 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:00.218831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d0569591-54b0-4b9c-971c-3c0c929f9494 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:00.304716 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-f70ddc35-69fa-4aa1-be27-1d9af59e308b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:00.316505 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-f70ddc35-69fa-4aa1-be27-1d9af59e308b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:00.319257 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-f70ddc35-69fa-4aa1-be27-1d9af59e308b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:00.320958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-f70ddc35-69fa-4aa1-be27-1d9af59e308b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1722 microversion: 2.20 time: 0.172282 Jun 16 00:30:00.322070 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 184/356] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:00 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:00.375781 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d0569591-54b0-4b9c-971c-3c0c929f9494 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:00.384460 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d0569591-54b0-4b9c-971c-3c0c929f9494 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f" status: 200 len: 1504 microversion: 2.1 time: 0.181703 Jun 16 00:30:00.385056 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 173/357] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:00 2022] GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f => generated 1504 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:00.969446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-aeec5b4f-b548-4e77-a78f-e1acc2d7b18c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:00.970117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-aeec5b4f-b548-4e77-a78f-e1acc2d7b18c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:00.977882 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-aeec5b4f-b548-4e77-a78f-e1acc2d7b18c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:00.978337 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-aeec5b4f-b548-4e77-a78f-e1acc2d7b18c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:00.979114 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-aeec5b4f-b548-4e77-a78f-e1acc2d7b18c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:00.979554 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-aeec5b4f-b548-4e77-a78f-e1acc2d7b18c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:01.120932 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-aeec5b4f-b548-4e77-a78f-e1acc2d7b18c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:01.128343 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-aeec5b4f-b548-4e77-a78f-e1acc2d7b18c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1371 microversion: 2.1 time: 0.163280 Jun 16 00:30:01.128912 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 185/358] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:00 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:01.341735 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-f42ba2cf-87b0-48a5-ac97-bd9d8e592f70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:01.342343 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-f42ba2cf-87b0-48a5-ac97-bd9d8e592f70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:01.349110 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f42ba2cf-87b0-48a5-ac97-bd9d8e592f70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:01.349551 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f42ba2cf-87b0-48a5-ac97-bd9d8e592f70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:01.350309 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f42ba2cf-87b0-48a5-ac97-bd9d8e592f70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:01.351215 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f42ba2cf-87b0-48a5-ac97-bd9d8e592f70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:01.401501 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-05af5b00-e603-4f60-b985-ff9d3a00df0c tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:01.402232 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-05af5b00-e603-4f60-b985-ff9d3a00df0c tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 59e8ed9c-a1d0-4799-8602-3536fcb3e81f] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:01.408450 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-05af5b00-e603-4f60-b985-ff9d3a00df0c tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:01.408904 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-05af5b00-e603-4f60-b985-ff9d3a00df0c tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:01.409671 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-05af5b00-e603-4f60-b985-ff9d3a00df0c tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:01.410096 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-05af5b00-e603-4f60-b985-ff9d3a00df0c tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:01.485908 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f42ba2cf-87b0-48a5-ac97-bd9d8e592f70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:01.494799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f42ba2cf-87b0-48a5-ac97-bd9d8e592f70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:01.496387 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f42ba2cf-87b0-48a5-ac97-bd9d8e592f70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:01.497641 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-f42ba2cf-87b0-48a5-ac97-bd9d8e592f70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1722 microversion: 2.20 time: 0.160065 Jun 16 00:30:01.498332 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 174/359] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:01 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:01.553189 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-05af5b00-e603-4f60-b985-ff9d3a00df0c tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:01.560703 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-05af5b00-e603-4f60-b985-ff9d3a00df0c tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f" status: 200 len: 1504 microversion: 2.1 time: 0.163020 Jun 16 00:30:01.561326 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 186/360] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:01 2022] GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:30:02.146226 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-172d5266-8279-4b3e-aa8d-9b7e8f1180fd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:02.146943 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-172d5266-8279-4b3e-aa8d-9b7e8f1180fd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:02.153201 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-172d5266-8279-4b3e-aa8d-9b7e8f1180fd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:02.153647 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-172d5266-8279-4b3e-aa8d-9b7e8f1180fd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:02.154414 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-172d5266-8279-4b3e-aa8d-9b7e8f1180fd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:02.154849 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-172d5266-8279-4b3e-aa8d-9b7e8f1180fd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:02.281744 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-172d5266-8279-4b3e-aa8d-9b7e8f1180fd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:02.289630 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-172d5266-8279-4b3e-aa8d-9b7e8f1180fd tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1371 microversion: 2.1 time: 0.148088 Jun 16 00:30:02.290197 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 175/361] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:02 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:02.516467 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-0d1ebaf0-57a5-4b45-8ad9-7ad4dae54a0b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:02.517201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-0d1ebaf0-57a5-4b45-8ad9-7ad4dae54a0b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:02.525845 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0d1ebaf0-57a5-4b45-8ad9-7ad4dae54a0b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:02.526292 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0d1ebaf0-57a5-4b45-8ad9-7ad4dae54a0b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:02.527050 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0d1ebaf0-57a5-4b45-8ad9-7ad4dae54a0b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:02.527478 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0d1ebaf0-57a5-4b45-8ad9-7ad4dae54a0b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:02.584733 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-6ca66182-c7fa-43b2-b8a0-bb986c41aa57 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:02.585364 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-6ca66182-c7fa-43b2-b8a0-bb986c41aa57 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 59e8ed9c-a1d0-4799-8602-3536fcb3e81f] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:02.591801 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6ca66182-c7fa-43b2-b8a0-bb986c41aa57 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:02.592247 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6ca66182-c7fa-43b2-b8a0-bb986c41aa57 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:02.593040 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6ca66182-c7fa-43b2-b8a0-bb986c41aa57 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:02.593475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6ca66182-c7fa-43b2-b8a0-bb986c41aa57 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:02.670755 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-0d1ebaf0-57a5-4b45-8ad9-7ad4dae54a0b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:02.679037 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-0d1ebaf0-57a5-4b45-8ad9-7ad4dae54a0b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:02.680596 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-0d1ebaf0-57a5-4b45-8ad9-7ad4dae54a0b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:02.681718 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-0d1ebaf0-57a5-4b45-8ad9-7ad4dae54a0b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1722 microversion: 2.20 time: 0.169733 Jun 16 00:30:02.682277 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 187/362] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:02 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:02.737178 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-6ca66182-c7fa-43b2-b8a0-bb986c41aa57 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:02.744548 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-6ca66182-c7fa-43b2-b8a0-bb986c41aa57 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f" status: 200 len: 1504 microversion: 2.1 time: 0.164522 Jun 16 00:30:02.745136 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 176/363] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:02 2022] GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:30:03.188746 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-829ccbda-dae5-40df-8b54-ca52b6f83041 req-46c01c09-1a44-4e01-9d81-a7aa458c63a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b227643-24e7-44b6-acf7-d3801014a8c7", "name": "network-vif-unplugged", "status": "completed", "tag": "c88ef649-3637-4f5d-955c-f88ebc0bb6c5"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:03.198674 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-829ccbda-dae5-40df-8b54-ca52b6f83041 req-46c01c09-1a44-4e01-9d81-a7aa458c63a7 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:03.199786 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-829ccbda-dae5-40df-8b54-ca52b6f83041 req-46c01c09-1a44-4e01-9d81-a7aa458c63a7 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:03.216808 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-829ccbda-dae5-40df-8b54-ca52b6f83041 req-46c01c09-1a44-4e01-9d81-a7aa458c63a7 service nova] Creating event network-vif-unplugged:c88ef649-3637-4f5d-955c-f88ebc0bb6c5 for instance 6b227643-24e7-44b6-acf7-d3801014a8c7 on hv-cinder-84599 Jun 16 00:30:03.224411 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-829ccbda-dae5-40df-8b54-ca52b6f83041 req-46c01c09-1a44-4e01-9d81-a7aa458c63a7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040664 Jun 16 00:30:03.225730 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 188/364] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:30:03.307181 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-f2a5e9c9-9bfe-4c10-bc30-322214b1b126 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:03.307797 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-f2a5e9c9-9bfe-4c10-bc30-322214b1b126 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:03.314356 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f2a5e9c9-9bfe-4c10-bc30-322214b1b126 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:03.315070 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f2a5e9c9-9bfe-4c10-bc30-322214b1b126 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:03.316011 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f2a5e9c9-9bfe-4c10-bc30-322214b1b126 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:03.316669 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f2a5e9c9-9bfe-4c10-bc30-322214b1b126 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:03.466744 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f2a5e9c9-9bfe-4c10-bc30-322214b1b126 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:03.474799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-f2a5e9c9-9bfe-4c10-bc30-322214b1b126 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1371 microversion: 2.1 time: 0.171584 Jun 16 00:30:03.475354 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 177/365] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:03 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:03.700928 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-e7ab92f7-7b07-4b50-a4d2-8c0c86a628e7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:03.701654 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-e7ab92f7-7b07-4b50-a4d2-8c0c86a628e7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:03.708664 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e7ab92f7-7b07-4b50-a4d2-8c0c86a628e7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:03.709069 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e7ab92f7-7b07-4b50-a4d2-8c0c86a628e7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:03.709839 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e7ab92f7-7b07-4b50-a4d2-8c0c86a628e7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:03.710304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e7ab92f7-7b07-4b50-a4d2-8c0c86a628e7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:03.761226 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-ead84b35-081e-4991-9c95-7827b51e18b9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:03.761865 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-ead84b35-081e-4991-9c95-7827b51e18b9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 59e8ed9c-a1d0-4799-8602-3536fcb3e81f] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:03.768371 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ead84b35-081e-4991-9c95-7827b51e18b9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:03.768811 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ead84b35-081e-4991-9c95-7827b51e18b9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:03.770149 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ead84b35-081e-4991-9c95-7827b51e18b9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:03.770689 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ead84b35-081e-4991-9c95-7827b51e18b9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:03.846602 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-e7ab92f7-7b07-4b50-a4d2-8c0c86a628e7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:03.855956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-e7ab92f7-7b07-4b50-a4d2-8c0c86a628e7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:03.857472 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-e7ab92f7-7b07-4b50-a4d2-8c0c86a628e7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:03.858621 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-e7ab92f7-7b07-4b50-a4d2-8c0c86a628e7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1725 microversion: 2.20 time: 0.161908 Jun 16 00:30:03.859172 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 189/366] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:03 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:03.876084 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-282b5704-3eba-426a-82c1-a278c015fd7b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4eac7612-be72-46af-996f-32b39f8edcd9"}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:03.877230 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-282b5704-3eba-426a-82c1-a278c015fd7b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:03.883845 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-282b5704-3eba-426a-82c1-a278c015fd7b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:03.884289 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-282b5704-3eba-426a-82c1-a278c015fd7b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:03.885086 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-282b5704-3eba-426a-82c1-a278c015fd7b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:03.885517 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-282b5704-3eba-426a-82c1-a278c015fd7b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:03.904214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-ead84b35-081e-4991-9c95-7827b51e18b9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:03.912424 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-ead84b35-081e-4991-9c95-7827b51e18b9 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f" status: 200 len: 1504 microversion: 2.1 time: 0.155007 Jun 16 00:30:03.913110 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 178/367] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:03 2022] GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:30:04.172737 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-282b5704-3eba-426a-82c1-a278c015fd7b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "POST /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.300578 Jun 16 00:30:04.173378 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 190/368] 10.222.0.23 () {62 vars in 1363 bytes} [Thu Jun 16 00:30:03 2022] POST /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7/os-volume_attachments => generated 188 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 00:30:04.287973 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d61e3305-15a7-46b9-b7be-8a3d02d5b651 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:04.288482 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d61e3305-15a7-46b9-b7be-8a3d02d5b651 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:04.294476 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d61e3305-15a7-46b9-b7be-8a3d02d5b651 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:04.294932 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d61e3305-15a7-46b9-b7be-8a3d02d5b651 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:04.295645 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d61e3305-15a7-46b9-b7be-8a3d02d5b651 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:04.296073 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d61e3305-15a7-46b9-b7be-8a3d02d5b651 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:04.398859 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d61e3305-15a7-46b9-b7be-8a3d02d5b651 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "POST /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7/action" status: 202 len: 0 microversion: 2.20 time: 0.115594 Jun 16 00:30:04.400094 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 179/369] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Jun 16 00:30:04 2022] POST /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:30:04.408531 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b93bd494-a66d-4106-8e39-510c0764f93c tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:04.411263 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-b93bd494-a66d-4106-8e39-510c0764f93c tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:04.419230 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b93bd494-a66d-4106-8e39-510c0764f93c tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:04.419683 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b93bd494-a66d-4106-8e39-510c0764f93c tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:04.420659 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b93bd494-a66d-4106-8e39-510c0764f93c tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:04.421162 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b93bd494-a66d-4106-8e39-510c0764f93c tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:04.492664 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-9c7f0d6b-3c10-4799-bdca-7b3cff30f90e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:04.493873 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-9c7f0d6b-3c10-4799-bdca-7b3cff30f90e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:04.503731 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9c7f0d6b-3c10-4799-bdca-7b3cff30f90e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:04.505167 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9c7f0d6b-3c10-4799-bdca-7b3cff30f90e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:04.506296 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9c7f0d6b-3c10-4799-bdca-7b3cff30f90e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:04.506892 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9c7f0d6b-3c10-4799-bdca-7b3cff30f90e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:04.621909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-b93bd494-a66d-4106-8e39-510c0764f93c tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:04.633479 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-b93bd494-a66d-4106-8e39-510c0764f93c tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:04.635000 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-b93bd494-a66d-4106-8e39-510c0764f93c tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:04.636185 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-b93bd494-a66d-4106-8e39-510c0764f93c tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1811 microversion: 2.20 time: 0.232165 Jun 16 00:30:04.637202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 191/370] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:04 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1811 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:04.930616 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-145cf461-776b-428a-84be-295e27c524d2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:04.931286 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-145cf461-776b-428a-84be-295e27c524d2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 59e8ed9c-a1d0-4799-8602-3536fcb3e81f] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:04.939989 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-145cf461-776b-428a-84be-295e27c524d2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:04.940665 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-145cf461-776b-428a-84be-295e27c524d2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:04.942249 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-145cf461-776b-428a-84be-295e27c524d2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:04.943146 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-145cf461-776b-428a-84be-295e27c524d2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:05.040439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-9c7f0d6b-3c10-4799-bdca-7b3cff30f90e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:05.045384 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:05.051524 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-9c7f0d6b-3c10-4799-bdca-7b3cff30f90e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1371 microversion: 2.1 time: 0.563040 Jun 16 00:30:05.052340 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 180/371] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:04 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1371 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:05.172398 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-145cf461-776b-428a-84be-295e27c524d2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38b6c63c1649d68302de51cc3424c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8055262b50d4e93b290315d0e57bd70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:05.176526 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:05.182815 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-145cf461-776b-428a-84be-295e27c524d2 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f" status: 200 len: 1504 microversion: 2.1 time: 0.257070 Jun 16 00:30:05.192639 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 192/372] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:04 2022] GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:30:05.233839 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-10517c95-9cfe-4643-aa87-c8e2c3253f9a req-2adeea70-167e-4509-b4be-0e26d9f88a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e8ed9c-a1d0-4799-8602-3536fcb3e81f", "name": "network-vif-deleted", "tag": "8ff22bd5-a74f-411b-8716-1856d70849df"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:05.246853 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-10517c95-9cfe-4643-aa87-c8e2c3253f9a req-2adeea70-167e-4509-b4be-0e26d9f88a3c service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:05.247341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-10517c95-9cfe-4643-aa87-c8e2c3253f9a req-2adeea70-167e-4509-b4be-0e26d9f88a3c service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:05.261076 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-10517c95-9cfe-4643-aa87-c8e2c3253f9a req-2adeea70-167e-4509-b4be-0e26d9f88a3c service nova] Creating event network-vif-deleted:8ff22bd5-a74f-411b-8716-1856d70849df for instance 59e8ed9c-a1d0-4799-8602-3536fcb3e81f on hv-cinder-84599 Jun 16 00:30:05.267309 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-10517c95-9cfe-4643-aa87-c8e2c3253f9a req-2adeea70-167e-4509-b4be-0e26d9f88a3c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038725 Jun 16 00:30:05.267980 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 181/373] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:30:05.655603 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-6c6a4300-c01f-441a-aa69-0060f684302b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:05.656206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-6c6a4300-c01f-441a-aa69-0060f684302b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:05.664057 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6c6a4300-c01f-441a-aa69-0060f684302b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:05.664548 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6c6a4300-c01f-441a-aa69-0060f684302b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:05.665587 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6c6a4300-c01f-441a-aa69-0060f684302b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:05.666237 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6c6a4300-c01f-441a-aa69-0060f684302b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:05.829731 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-6c6a4300-c01f-441a-aa69-0060f684302b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:05.844572 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-6c6a4300-c01f-441a-aa69-0060f684302b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:05.846107 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-6c6a4300-c01f-441a-aa69-0060f684302b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:05.847262 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-6c6a4300-c01f-441a-aa69-0060f684302b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1751 microversion: 2.20 time: 0.196383 Jun 16 00:30:05.847908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 193/374] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:05 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1751 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:06.071040 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-94220e25-6e6e-46b9-87c6-14e726390a75 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:06.071737 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-94220e25-6e6e-46b9-87c6-14e726390a75 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:06.078991 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-94220e25-6e6e-46b9-87c6-14e726390a75 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:06.079586 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-94220e25-6e6e-46b9-87c6-14e726390a75 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:06.080408 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-94220e25-6e6e-46b9-87c6-14e726390a75 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:06.080942 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-94220e25-6e6e-46b9-87c6-14e726390a75 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:06.199863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-3149b946-a03b-457f-bd13-11a2543b6250 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:06.200456 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-3149b946-a03b-457f-bd13-11a2543b6250 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] [instance: 59e8ed9c-a1d0-4799-8602-3536fcb3e81f] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:06.206618 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3149b946-a03b-457f-bd13-11a2543b6250 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:06.207803 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3149b946-a03b-457f-bd13-11a2543b6250 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:06.208902 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3149b946-a03b-457f-bd13-11a2543b6250 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:06.209322 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3149b946-a03b-457f-bd13-11a2543b6250 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:06.219162 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-94220e25-6e6e-46b9-87c6-14e726390a75 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:06.224032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-3149b946-a03b-457f-bd13-11a2543b6250 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] HTTP exception thrown: Instance 59e8ed9c-a1d0-4799-8602-3536fcb3e81f could not be found. Jun 16 00:30:06.227193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-94220e25-6e6e-46b9-87c6-14e726390a75 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1565 microversion: 2.1 time: 0.161961 Jun 16 00:30:06.227838 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 182/375] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:06 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:06.228207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-3149b946-a03b-457f-bd13-11a2543b6250 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Request method failure captured: Jun 16 00:30:06.228207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f HTTP/1.1 Jun 16 00:30:06.228207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:30:06.228207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:30:06.228207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:30:06.228207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:30:06.228207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:30:06.228207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:30:06.228207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:30:06.228207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:30:06.228207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnlMh_Uf7XK91_LDaiz6gJztsUZs6AcB0dWWOMq7br_s59P9EoxRg9RH9F_MxaZVL75qKYoRzHVnI7tjoGQ5weTTC8u0jhxppN5ZIVkJ2a0MBJVh3LQNCT0pY-ouqVnYhcINLEO155KXZztPWYFWsXpN5WBliVH5QZafGgEIEBcDr7Q Jun 16 00:30:06.228207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:30:06.228207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:30:06.228207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:30:06.228207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:30:06.228207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:30:06.228207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:30:06.228207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: c8055262b50d4e93b290315d0e57bd70 Jun 16 00:30:06.228207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-VolumesActionsTest-215830791 Jun 16 00:30:06.228207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:30:06.228207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:30:06.229530 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8055262b50d4e93b290315d0e57bd70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8055262b50d4e93b290315d0e57bd70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8055262b50d4e93b290315d0e57bd70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8055262b50d4e93b290315d0e57bd70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:30:06.229530 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-VolumesActionsTest-215830791 Jun 16 00:30:06.229530 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: c8055262b50d4e93b290315d0e57bd70 Jun 16 00:30:06.229530 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-VolumesActionsTest-215830791 Jun 16 00:30:06.229530 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-VolumesActionsTest-215830791-project Jun 16 00:30:06.229530 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:30:06.229530 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:30:06.229530 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: ac38b6c63c1649d68302de51cc3424c1 Jun 16 00:30:06.229530 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-VolumesActionsTest-215830791-project Jun 16 00:30:06.229530 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:30:06.229530 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Instance 59e8ed9c-a1d0-4799-8602-3536fcb3e81f could not be found. Jun 16 00:30:06.229530 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': '59e8ed9c-a1d0-4799-8602-3536fcb3e81f'} Jun 16 00:30:06.230228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:30:06.230228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:30:06.230228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:30:06.230228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:30:06.230228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:30:06.230228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:30:06.230228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:30:06.230228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:30:06.230228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:30:06.230228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:30:06.230228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59e8ed9c-a1d0-4799-8602-3536fcb3e81f could not be found. Jun 16 00:30:06.230228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:30:06.230228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:30:06.230228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:30:06.230228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:30:06.230228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:30:06.230228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:30:06.230228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:30:06.230228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:30:06.230228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:30:06.231427 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:30:06.231427 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:30:06.231427 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:30:06.231427 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:30:06.231427 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:30:06.231427 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:30:06.231427 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:30:06.231427 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59e8ed9c-a1d0-4799-8602-3536fcb3e81f could not be found. Jun 16 00:30:06.231427 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:30:06.231427 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:30:06.231427 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:30:06.231427 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:30:06.231427 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:30:06.231427 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:30:06.231427 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:30:06.231427 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:30:06.231427 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59e8ed9c-a1d0-4799-8602-3536fcb3e81f could not be found. Jun 16 00:30:06.231427 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:30:06.232476 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-3149b946-a03b-457f-bd13-11a2543b6250 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] Returning 404 to user: Instance 59e8ed9c-a1d0-4799-8602-3536fcb3e81f could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:30:06.232476 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-3149b946-a03b-457f-bd13-11a2543b6250 tempest-VolumesActionsTest-215830791 tempest-VolumesActionsTest-215830791-project] 10.222.0.23 "GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f" status: 404 len: 111 microversion: 2.1 time: 0.034564 Jun 16 00:30:06.232476 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 194/376] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:06 2022] GET /compute/v2.1/servers/59e8ed9c-a1d0-4799-8602-3536fcb3e81f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 00:30:06.246593 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-fe7a898b-9140-4a5c-9515-2a7d4daaaf51 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:06.247090 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-fe7a898b-9140-4a5c-9515-2a7d4daaaf51 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:06.253517 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fe7a898b-9140-4a5c-9515-2a7d4daaaf51 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:06.254627 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fe7a898b-9140-4a5c-9515-2a7d4daaaf51 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:06.255393 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fe7a898b-9140-4a5c-9515-2a7d4daaaf51 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:06.255834 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fe7a898b-9140-4a5c-9515-2a7d4daaaf51 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:06.351128 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-fe7a898b-9140-4a5c-9515-2a7d4daaaf51 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108555 Jun 16 00:30:06.351723 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 183/377] 10.222.0.23 () {58 vars in 1274 bytes} [Thu Jun 16 00:30:06 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:30:06.876319 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-f0e87660-a3d1-472f-85c4-e4c3b019bcf5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:06.876957 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-f0e87660-a3d1-472f-85c4-e4c3b019bcf5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:06.885372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f0e87660-a3d1-472f-85c4-e4c3b019bcf5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:06.885827 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f0e87660-a3d1-472f-85c4-e4c3b019bcf5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:06.886656 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f0e87660-a3d1-472f-85c4-e4c3b019bcf5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:06.887135 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f0e87660-a3d1-472f-85c4-e4c3b019bcf5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:07.062847 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-f0e87660-a3d1-472f-85c4-e4c3b019bcf5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:07.073978 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-f0e87660-a3d1-472f-85c4-e4c3b019bcf5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:07.075925 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-f0e87660-a3d1-472f-85c4-e4c3b019bcf5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:07.077268 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-f0e87660-a3d1-472f-85c4-e4c3b019bcf5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.213650 Jun 16 00:30:07.078332 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 195/378] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:06 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:07.447159 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-5fd4bd3a-2159-4a7b-8ad1-512c327d36bb req-f337edea-b560-4cc8-99f5-5793a90b7085 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8298735b-2311-40d2-9261-ba64afe3b7fe", "tag": "c5105353-b394-4e1d-81d1-b94b0637e747"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:07.455236 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-5fd4bd3a-2159-4a7b-8ad1-512c327d36bb req-f337edea-b560-4cc8-99f5-5793a90b7085 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:07.455748 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-5fd4bd3a-2159-4a7b-8ad1-512c327d36bb req-f337edea-b560-4cc8-99f5-5793a90b7085 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:07.467375 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-5fd4bd3a-2159-4a7b-8ad1-512c327d36bb req-f337edea-b560-4cc8-99f5-5793a90b7085 service nova] Creating event network-changed:c5105353-b394-4e1d-81d1-b94b0637e747 for instance 8298735b-2311-40d2-9261-ba64afe3b7fe on hv-cinder-84599 Jun 16 00:30:07.472188 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-5fd4bd3a-2159-4a7b-8ad1-512c327d36bb req-f337edea-b560-4cc8-99f5-5793a90b7085 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029145 Jun 16 00:30:07.473382 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 184/379] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:30:07.841075 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-3bf284f3-daa9-4ad1-a8db-8bb4d23173cb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:07.841635 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-3bf284f3-daa9-4ad1-a8db-8bb4d23173cb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:07.848166 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3bf284f3-daa9-4ad1-a8db-8bb4d23173cb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:07.848625 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3bf284f3-daa9-4ad1-a8db-8bb4d23173cb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:07.849425 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3bf284f3-daa9-4ad1-a8db-8bb4d23173cb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:07.849862 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3bf284f3-daa9-4ad1-a8db-8bb4d23173cb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:07.874803 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-3bf284f3-daa9-4ad1-a8db-8bb4d23173cb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124/ips" status: 200 len: 147 microversion: 2.1 time: 0.037585 Jun 16 00:30:07.875364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 196/380] 10.222.0.23 () {58 vars in 1247 bytes} [Thu Jun 16 00:30:07 2022] GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:30:08.099874 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-86289685-4610-4ab6-b10c-60b4d5855ed8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:08.100587 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-86289685-4610-4ab6-b10c-60b4d5855ed8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:08.107934 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-86289685-4610-4ab6-b10c-60b4d5855ed8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:08.108614 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-86289685-4610-4ab6-b10c-60b4d5855ed8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:08.109576 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-86289685-4610-4ab6-b10c-60b4d5855ed8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:08.110173 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-86289685-4610-4ab6-b10c-60b4d5855ed8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:08.306417 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-86289685-4610-4ab6-b10c-60b4d5855ed8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:08.315354 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-86289685-4610-4ab6-b10c-60b4d5855ed8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:08.318325 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-86289685-4610-4ab6-b10c-60b4d5855ed8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:08.319744 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-86289685-4610-4ab6-b10c-60b4d5855ed8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.226188 Jun 16 00:30:08.320299 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 185/381] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:08 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:09.339102 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-fb769289-b6d7-40b2-bc85-84b08db16c44 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:09.339701 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-fb769289-b6d7-40b2-bc85-84b08db16c44 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:09.345885 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fb769289-b6d7-40b2-bc85-84b08db16c44 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:09.346318 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fb769289-b6d7-40b2-bc85-84b08db16c44 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:09.347062 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fb769289-b6d7-40b2-bc85-84b08db16c44 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:09.348054 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fb769289-b6d7-40b2-bc85-84b08db16c44 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:09.475201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-fb769289-b6d7-40b2-bc85-84b08db16c44 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:09.484726 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-fb769289-b6d7-40b2-bc85-84b08db16c44 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:09.486222 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-fb769289-b6d7-40b2-bc85-84b08db16c44 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:09.487350 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-fb769289-b6d7-40b2-bc85-84b08db16c44 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.152127 Jun 16 00:30:09.487890 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 197/382] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:09 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:10.506381 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-6b4cf8d3-63ce-488d-91da-92f93d0610f1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:10.506983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-6b4cf8d3-63ce-488d-91da-92f93d0610f1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:10.513658 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6b4cf8d3-63ce-488d-91da-92f93d0610f1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:10.514113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6b4cf8d3-63ce-488d-91da-92f93d0610f1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:10.514920 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6b4cf8d3-63ce-488d-91da-92f93d0610f1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:10.515309 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6b4cf8d3-63ce-488d-91da-92f93d0610f1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:10.813781 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-6b4cf8d3-63ce-488d-91da-92f93d0610f1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:10.822279 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-6b4cf8d3-63ce-488d-91da-92f93d0610f1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:10.823841 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-6b4cf8d3-63ce-488d-91da-92f93d0610f1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:10.825078 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-6b4cf8d3-63ce-488d-91da-92f93d0610f1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.323200 Jun 16 00:30:10.825629 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 186/383] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:10 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:11.429862 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-f2e13239-92aa-4866-bf58-71fe0990badf tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5c3a275-77d5-41b1-b144-52edbdeb2c3b"}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:11.433508 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-f2e13239-92aa-4866-bf58-71fe0990badf tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:11.443596 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:11.446698 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f2e13239-92aa-4866-bf58-71fe0990badf tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:11.449092 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f2e13239-92aa-4866-bf58-71fe0990badf tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:11.450946 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f2e13239-92aa-4866-bf58-71fe0990badf tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:11.454513 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f2e13239-92aa-4866-bf58-71fe0990badf tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:11.850516 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-af6d228c-784c-46b5-8ee7-da3bbf3732ea tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:11.851235 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-af6d228c-784c-46b5-8ee7-da3bbf3732ea tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:11.878025 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-af6d228c-784c-46b5-8ee7-da3bbf3732ea tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:11.880665 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-af6d228c-784c-46b5-8ee7-da3bbf3732ea tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:11.883839 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-af6d228c-784c-46b5-8ee7-da3bbf3732ea tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:11.884389 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-af6d228c-784c-46b5-8ee7-da3bbf3732ea tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:11.906666 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-f2e13239-92aa-4866-bf58-71fe0990badf tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "POST /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.481870 Jun 16 00:30:11.913228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 198/384] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Jun 16 00:30:11 2022] POST /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124/os-volume_attachments => generated 194 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:30:12.214189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-af6d228c-784c-46b5-8ee7-da3bbf3732ea tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:12.239706 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-af6d228c-784c-46b5-8ee7-da3bbf3732ea tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:12.246382 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-af6d228c-784c-46b5-8ee7-da3bbf3732ea tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:12.247994 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-af6d228c-784c-46b5-8ee7-da3bbf3732ea tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.405638 Jun 16 00:30:12.250270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 187/385] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:11 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:13.278783 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-f30f751d-0efd-43c8-8ec9-9b35e72f7345 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:13.281382 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-f30f751d-0efd-43c8-8ec9-9b35e72f7345 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:13.299688 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f30f751d-0efd-43c8-8ec9-9b35e72f7345 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:13.303713 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f30f751d-0efd-43c8-8ec9-9b35e72f7345 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:13.305143 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f30f751d-0efd-43c8-8ec9-9b35e72f7345 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:13.306282 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f30f751d-0efd-43c8-8ec9-9b35e72f7345 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:13.627426 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-f30f751d-0efd-43c8-8ec9-9b35e72f7345 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:13.650978 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-f30f751d-0efd-43c8-8ec9-9b35e72f7345 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:13.652462 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-f30f751d-0efd-43c8-8ec9-9b35e72f7345 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:13.674202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-f30f751d-0efd-43c8-8ec9-9b35e72f7345 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.407924 Jun 16 00:30:13.688397 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 199/386] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:13 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:14.694458 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-09be9845-a893-4813-bac8-14bd2a0ff080 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:14.695869 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-09be9845-a893-4813-bac8-14bd2a0ff080 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:14.703411 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-09be9845-a893-4813-bac8-14bd2a0ff080 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:14.710889 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-09be9845-a893-4813-bac8-14bd2a0ff080 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:14.711817 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-09be9845-a893-4813-bac8-14bd2a0ff080 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:14.712573 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-09be9845-a893-4813-bac8-14bd2a0ff080 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:15.012996 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-09be9845-a893-4813-bac8-14bd2a0ff080 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:15.051595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-09be9845-a893-4813-bac8-14bd2a0ff080 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:15.055267 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-09be9845-a893-4813-bac8-14bd2a0ff080 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:15.057407 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-09be9845-a893-4813-bac8-14bd2a0ff080 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.367938 Jun 16 00:30:15.058605 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 188/387] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:14 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:16.077001 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-59b5b2a1-74c7-47da-abeb-02bf0a9c221b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:16.078316 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-59b5b2a1-74c7-47da-abeb-02bf0a9c221b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:16.089803 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59b5b2a1-74c7-47da-abeb-02bf0a9c221b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:16.092898 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59b5b2a1-74c7-47da-abeb-02bf0a9c221b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:16.094146 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59b5b2a1-74c7-47da-abeb-02bf0a9c221b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:16.100149 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59b5b2a1-74c7-47da-abeb-02bf0a9c221b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:16.398969 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-59b5b2a1-74c7-47da-abeb-02bf0a9c221b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:16.421729 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-59b5b2a1-74c7-47da-abeb-02bf0a9c221b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:16.438231 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-59b5b2a1-74c7-47da-abeb-02bf0a9c221b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:16.452018 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-59b5b2a1-74c7-47da-abeb-02bf0a9c221b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.379879 Jun 16 00:30:16.459038 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 200/388] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:16 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:17.481751 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d20f7bde-e695-4b06-b807-27759791d354 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:17.482400 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d20f7bde-e695-4b06-b807-27759791d354 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:17.484958 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=74 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:17.502639 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d20f7bde-e695-4b06-b807-27759791d354 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:17.503097 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d20f7bde-e695-4b06-b807-27759791d354 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:17.504397 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d20f7bde-e695-4b06-b807-27759791d354 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:17.504824 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d20f7bde-e695-4b06-b807-27759791d354 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:17.812595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d20f7bde-e695-4b06-b807-27759791d354 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:17.826380 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d20f7bde-e695-4b06-b807-27759791d354 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:17.831183 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d20f7bde-e695-4b06-b807-27759791d354 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:17.834979 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d20f7bde-e695-4b06-b807-27759791d354 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.357147 Jun 16 00:30:17.837022 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 189/389] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:17 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:18.854880 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-5393f44f-a76b-42f1-9e30-5db9b1719b1d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:18.855486 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-5393f44f-a76b-42f1-9e30-5db9b1719b1d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:18.870907 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5393f44f-a76b-42f1-9e30-5db9b1719b1d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:18.871363 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5393f44f-a76b-42f1-9e30-5db9b1719b1d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:18.872148 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5393f44f-a76b-42f1-9e30-5db9b1719b1d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:18.872580 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5393f44f-a76b-42f1-9e30-5db9b1719b1d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:19.151214 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-5393f44f-a76b-42f1-9e30-5db9b1719b1d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:19.166948 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-5393f44f-a76b-42f1-9e30-5db9b1719b1d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:19.172431 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-5393f44f-a76b-42f1-9e30-5db9b1719b1d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:19.177419 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-5393f44f-a76b-42f1-9e30-5db9b1719b1d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.324943 Jun 16 00:30:19.178229 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 201/390] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:18 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:20.025529 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-f34365a3-7401-47dc-8c35-2a9e7833d404 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Action: 'create', calling method: .version_select at 0x7fe707324310>, body: {"keypair": {"name": "tempest-keypair-1751190747", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJKQ/7h0LgV7N/ZzhmqHscdcnKirxhOh3PxcEZAmdeoHCDeApf+NFhzdKA21QhNXQ95fb7yQdQeQABzIS14zC97D/usx9JbiUMMrC+zGv9qAwRx7yH2PUfr+Xz5eAwxxw=="}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:20.064246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-f34365a3-7401-47dc-8c35-2a9e7833d404 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Getting quotas for project 2d5d56c0c6444b23a1ac6cc2fcb0bb52. Resources: {'key_pairs'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:30:20.071649 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-f34365a3-7401-47dc-8c35-2a9e7833d404 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Getting quotas for user 535a03ce19d346d59e6a6f6befb9dea0 and project 2d5d56c0c6444b23a1ac6cc2fcb0bb52. Resources: {'key_pairs'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:30:20.136769 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-f34365a3-7401-47dc-8c35-2a9e7833d404 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118494 Jun 16 00:30:20.138216 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 190/391] 10.222.0.23 () {60 vars in 1158 bytes} [Thu Jun 16 00:30:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:30:20.196535 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-7e62cfde-e578-4e04-9ae1-27e1f6f5838a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:20.197910 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-7e62cfde-e578-4e04-9ae1-27e1f6f5838a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:20.240127 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7e62cfde-e578-4e04-9ae1-27e1f6f5838a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:20.240774 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7e62cfde-e578-4e04-9ae1-27e1f6f5838a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:20.245481 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7e62cfde-e578-4e04-9ae1-27e1f6f5838a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:20.249628 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7e62cfde-e578-4e04-9ae1-27e1f6f5838a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:20.844368 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-7e62cfde-e578-4e04-9ae1-27e1f6f5838a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:20.856493 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-7e62cfde-e578-4e04-9ae1-27e1f6f5838a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:20.862994 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-7e62cfde-e578-4e04-9ae1-27e1f6f5838a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:20.872402 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-7e62cfde-e578-4e04-9ae1-27e1f6f5838a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.680516 Jun 16 00:30:20.874722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 202/392] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:20 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:21.896678 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b1aaf154-6146-4414-aeae-9b4299cddf1b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:21.898060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-b1aaf154-6146-4414-aeae-9b4299cddf1b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:21.923080 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b1aaf154-6146-4414-aeae-9b4299cddf1b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:21.923800 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b1aaf154-6146-4414-aeae-9b4299cddf1b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:21.924762 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b1aaf154-6146-4414-aeae-9b4299cddf1b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:21.925979 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b1aaf154-6146-4414-aeae-9b4299cddf1b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:22.289823 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b1aaf154-6146-4414-aeae-9b4299cddf1b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:22.299539 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b1aaf154-6146-4414-aeae-9b4299cddf1b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:22.308283 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b1aaf154-6146-4414-aeae-9b4299cddf1b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:22.310577 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-b1aaf154-6146-4414-aeae-9b4299cddf1b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.421653 Jun 16 00:30:22.313173 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 191/393] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:21 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:23.343619 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-5a8242db-8653-4971-8d50-0eb47315f0ae tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:23.344287 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-5a8242db-8653-4971-8d50-0eb47315f0ae tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:23.357987 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5a8242db-8653-4971-8d50-0eb47315f0ae tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:23.358439 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5a8242db-8653-4971-8d50-0eb47315f0ae tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:23.359225 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5a8242db-8653-4971-8d50-0eb47315f0ae tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:23.359661 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5a8242db-8653-4971-8d50-0eb47315f0ae tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:23.882582 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-5a8242db-8653-4971-8d50-0eb47315f0ae tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:23.898992 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-5a8242db-8653-4971-8d50-0eb47315f0ae tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:23.903323 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-5a8242db-8653-4971-8d50-0eb47315f0ae tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:23.908806 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-5a8242db-8653-4971-8d50-0eb47315f0ae tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.567766 Jun 16 00:30:23.923025 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 203/394] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:23 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:24.295655 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d9ea5217-b8bf-4bd4-a8bb-a65133dda3be tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1631187736", "imageRef": "d9a6de24-7a5e-4f8b-b078-809c87b15d56", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b338e4d-b5e8-4121-bb8b-45875ebd0e07"}], "security_groups": [{"name": "tempest-securitygroup--1597670611"}], "key_name": "tempest-keypair-1751190747", "user_data": "}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:24.928836 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-aa125acd-6809-44c3-a30a-824b82036420 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:24.929625 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-aa125acd-6809-44c3-a30a-824b82036420 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:24.946905 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-aa125acd-6809-44c3-a30a-824b82036420 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:24.947768 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-aa125acd-6809-44c3-a30a-824b82036420 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:24.953610 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-aa125acd-6809-44c3-a30a-824b82036420 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:24.954402 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-aa125acd-6809-44c3-a30a-824b82036420 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:25.776680 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-aa125acd-6809-44c3-a30a-824b82036420 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:25.808944 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-aa125acd-6809-44c3-a30a-824b82036420 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:25.810973 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-aa125acd-6809-44c3-a30a-824b82036420 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:25.817663 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-aa125acd-6809-44c3-a30a-824b82036420 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.891522 Jun 16 00:30:25.830103 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 204/395] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:24 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:26.840852 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-a7df19e0-67dd-48a9-b4cf-87d2a81ddb53 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:26.841568 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-a7df19e0-67dd-48a9-b4cf-87d2a81ddb53 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:26.866653 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a7df19e0-67dd-48a9-b4cf-87d2a81ddb53 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:26.869992 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a7df19e0-67dd-48a9-b4cf-87d2a81ddb53 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:26.870834 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a7df19e0-67dd-48a9-b4cf-87d2a81ddb53 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:26.876494 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a7df19e0-67dd-48a9-b4cf-87d2a81ddb53 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:27.301222 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-a7df19e0-67dd-48a9-b4cf-87d2a81ddb53 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:27.314287 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-a7df19e0-67dd-48a9-b4cf-87d2a81ddb53 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:27.321990 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-a7df19e0-67dd-48a9-b4cf-87d2a81ddb53 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:27.324144 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-a7df19e0-67dd-48a9-b4cf-87d2a81ddb53 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.487315 Jun 16 00:30:27.326882 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 205/396] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:26 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:28.344583 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d2ba242e-772f-454d-854f-5a4db5dba422 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:28.346119 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-d2ba242e-772f-454d-854f-5a4db5dba422 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:28.363705 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d2ba242e-772f-454d-854f-5a4db5dba422 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:28.364826 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d2ba242e-772f-454d-854f-5a4db5dba422 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:28.365615 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d2ba242e-772f-454d-854f-5a4db5dba422 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:28.366054 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d2ba242e-772f-454d-854f-5a4db5dba422 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:28.753298 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d2ba242e-772f-454d-854f-5a4db5dba422 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:28.782774 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d2ba242e-772f-454d-854f-5a4db5dba422 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:28.789603 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d2ba242e-772f-454d-854f-5a4db5dba422 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:28.795231 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-d2ba242e-772f-454d-854f-5a4db5dba422 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.454549 Jun 16 00:30:28.797045 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 206/397] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:28 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:30:29.817829 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-31a4b7f9-d499-4ca8-8b3a-3a9bd5e697c2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:29.819336 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-31a4b7f9-d499-4ca8-8b3a-3a9bd5e697c2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:29.856995 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-31a4b7f9-d499-4ca8-8b3a-3a9bd5e697c2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:29.857906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-31a4b7f9-d499-4ca8-8b3a-3a9bd5e697c2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:29.859030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-31a4b7f9-d499-4ca8-8b3a-3a9bd5e697c2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:29.859616 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-31a4b7f9-d499-4ca8-8b3a-3a9bd5e697c2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:30.087487 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=4 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:30.142216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-31a4b7f9-d499-4ca8-8b3a-3a9bd5e697c2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:30.157292 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-31a4b7f9-d499-4ca8-8b3a-3a9bd5e697c2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:30.163616 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-31a4b7f9-d499-4ca8-8b3a-3a9bd5e697c2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:30.165361 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-31a4b7f9-d499-4ca8-8b3a-3a9bd5e697c2 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.354051 Jun 16 00:30:30.166237 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 207/398] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:29 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:30:30.379091 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.network.neutron [None req-d9ea5217-b8bf-4bd4-a8bb-a65133dda3be tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] validate_networks() for [('5b338e4d-b5e8-4121-bb8b-45875ebd0e07', None, None, None, None, None)] {{(pid=124230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:30:31.069941 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-d9ea5217-b8bf-4bd4-a8bb-a65133dda3be tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Flavor limits 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:30:31.073420 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-d9ea5217-b8bf-4bd4-a8bb-a65133dda3be tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Image limits 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:30:31.075578 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-d9ea5217-b8bf-4bd4-a8bb-a65133dda3be tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Flavor pref 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:30:31.077838 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-d9ea5217-b8bf-4bd4-a8bb-a65133dda3be tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Image pref 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:30:31.078731 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-d9ea5217-b8bf-4bd4-a8bb-a65133dda3be tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:30:31.123440 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d9ea5217-b8bf-4bd4-a8bb-a65133dda3be tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:31.126786 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d9ea5217-b8bf-4bd4-a8bb-a65133dda3be tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:31.143942 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d9ea5217-b8bf-4bd4-a8bb-a65133dda3be tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:31.145307 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d9ea5217-b8bf-4bd4-a8bb-a65133dda3be tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:31.183766 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-394cfd25-369c-4719-ac58-70309f477403 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:31.185221 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-394cfd25-369c-4719-ac58-70309f477403 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:31.193389 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-394cfd25-369c-4719-ac58-70309f477403 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:31.194206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-394cfd25-369c-4719-ac58-70309f477403 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:31.195244 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-394cfd25-369c-4719-ac58-70309f477403 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:31.196155 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-394cfd25-369c-4719-ac58-70309f477403 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:31.218216 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-d9ea5217-b8bf-4bd4-a8bb-a65133dda3be tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Getting quotas for project 2d5d56c0c6444b23a1ac6cc2fcb0bb52. Resources: {'ram', 'cores', 'instances'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:30:31.229441 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-d9ea5217-b8bf-4bd4-a8bb-a65133dda3be tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Getting quotas for user 535a03ce19d346d59e6a6f6befb9dea0 and project 2d5d56c0c6444b23a1ac6cc2fcb0bb52. Resources: {'ram', 'cores', 'instances'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:30:31.254888 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d9ea5217-b8bf-4bd4-a8bb-a65133dda3be tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Going to run 1 instances... {{(pid=124230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:30:31.257578 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d9ea5217-b8bf-4bd4-a8bb-a65133dda3be tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d9a6de24-7a5e-4f8b-b078-809c87b15d56',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:30:31.324431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d9ea5217-b8bf-4bd4-a8bb-a65133dda3be tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 7.033229 Jun 16 00:30:31.331129 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 192/399] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Jun 16 00:30:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 7040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:30:31.336706 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-7b9f7adb-ec37-47e7-91c2-1e8e82d3b5b5 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:31.337495 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-7b9f7adb-ec37-47e7-91c2-1e8e82d3b5b5 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:31.395187 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-394cfd25-369c-4719-ac58-70309f477403 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:31.411080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-394cfd25-369c-4719-ac58-70309f477403 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:31.414435 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-394cfd25-369c-4719-ac58-70309f477403 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:31.416746 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-394cfd25-369c-4719-ac58-70309f477403 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.236652 Jun 16 00:30:31.427969 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 208/400] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:31 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:31.454466 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-7b9f7adb-ec37-47e7-91c2-1e8e82d3b5b5 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:31.467999 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-7b9f7adb-ec37-47e7-91c2-1e8e82d3b5b5 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66" status: 200 len: 1242 microversion: 2.1 time: 0.135630 Jun 16 00:30:31.473567 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 193/401] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:31 2022] GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 => generated 1242 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:32.436375 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-c2e0b16a-8041-4fe7-8def-1a7a7677fc66 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:32.445401 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-c2e0b16a-8041-4fe7-8def-1a7a7677fc66 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:32.458787 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c2e0b16a-8041-4fe7-8def-1a7a7677fc66 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:32.459244 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c2e0b16a-8041-4fe7-8def-1a7a7677fc66 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:32.460028 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c2e0b16a-8041-4fe7-8def-1a7a7677fc66 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:32.460461 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c2e0b16a-8041-4fe7-8def-1a7a7677fc66 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:32.498820 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c2b53d74-692f-48ac-b6e4-4c2ad9f03c31 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:32.505014 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c2b53d74-692f-48ac-b6e4-4c2ad9f03c31 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:32.516436 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:32.528299 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c2b53d74-692f-48ac-b6e4-4c2ad9f03c31 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:32.528993 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c2b53d74-692f-48ac-b6e4-4c2ad9f03c31 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:32.529969 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c2b53d74-692f-48ac-b6e4-4c2ad9f03c31 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:32.530821 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c2b53d74-692f-48ac-b6e4-4c2ad9f03c31 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:32.676234 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c2b53d74-692f-48ac-b6e4-4c2ad9f03c31 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:32.701202 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c2b53d74-692f-48ac-b6e4-4c2ad9f03c31 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66" status: 200 len: 1294 microversion: 2.1 time: 0.215007 Jun 16 00:30:32.701782 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 194/402] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:32 2022] GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 => generated 1294 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:32.851992 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-c2e0b16a-8041-4fe7-8def-1a7a7677fc66 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:32.879584 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-c2e0b16a-8041-4fe7-8def-1a7a7677fc66 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:32.884097 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-c2e0b16a-8041-4fe7-8def-1a7a7677fc66 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:32.886605 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-c2e0b16a-8041-4fe7-8def-1a7a7677fc66 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.454278 Jun 16 00:30:32.890822 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 209/403] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:32 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:33.732400 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-478be041-9243-4701-9f9a-e9768f87c08f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:33.733791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-478be041-9243-4701-9f9a-e9768f87c08f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:33.749459 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-478be041-9243-4701-9f9a-e9768f87c08f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:33.751447 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-478be041-9243-4701-9f9a-e9768f87c08f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:33.753111 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-478be041-9243-4701-9f9a-e9768f87c08f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:33.757702 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-478be041-9243-4701-9f9a-e9768f87c08f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:33.910024 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-1ad8477c-1d6c-402f-a958-2775fd198282 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:33.910648 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-1ad8477c-1d6c-402f-a958-2775fd198282 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:33.927739 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1ad8477c-1d6c-402f-a958-2775fd198282 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:33.939395 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1ad8477c-1d6c-402f-a958-2775fd198282 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:33.940973 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1ad8477c-1d6c-402f-a958-2775fd198282 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:33.941561 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1ad8477c-1d6c-402f-a958-2775fd198282 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:34.281234 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-1ad8477c-1d6c-402f-a958-2775fd198282 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:34.304841 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-1ad8477c-1d6c-402f-a958-2775fd198282 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:34.323812 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-1ad8477c-1d6c-402f-a958-2775fd198282 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:34.331020 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-1ad8477c-1d6c-402f-a958-2775fd198282 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.423731 Jun 16 00:30:34.334656 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 210/404] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:33 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:34.388965 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-478be041-9243-4701-9f9a-e9768f87c08f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:34.420189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-478be041-9243-4701-9f9a-e9768f87c08f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66" status: 200 len: 1368 microversion: 2.1 time: 0.704533 Jun 16 00:30:34.426939 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 195/405] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:33 2022] GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 => generated 1368 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:35.270660 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-ee7cf374-2ecf-4423-8413-998756e73c8a req-d40d08e3-a865-465a-b1a2-362bbd5ab476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52832e7d-aae4-4a38-81ec-e84727dd8d66", "tag": "5485f1e1-4a63-42e1-96bc-20193c388b65"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:35.288441 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-ee7cf374-2ecf-4423-8413-998756e73c8a req-d40d08e3-a865-465a-b1a2-362bbd5ab476 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:35.289273 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-ee7cf374-2ecf-4423-8413-998756e73c8a req-d40d08e3-a865-465a-b1a2-362bbd5ab476 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:35.318067 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-ee7cf374-2ecf-4423-8413-998756e73c8a req-d40d08e3-a865-465a-b1a2-362bbd5ab476 service nova] Creating event network-changed:5485f1e1-4a63-42e1-96bc-20193c388b65 for instance 52832e7d-aae4-4a38-81ec-e84727dd8d66 on hv-cinder-84599 Jun 16 00:30:35.326074 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-ee7cf374-2ecf-4423-8413-998756e73c8a req-d40d08e3-a865-465a-b1a2-362bbd5ab476 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064490 Jun 16 00:30:35.331435 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 211/406] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:30:35.352624 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-2a3fa295-09ee-405e-b955-e7353eccdad4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:35.353928 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-2a3fa295-09ee-405e-b955-e7353eccdad4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:35.369170 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2a3fa295-09ee-405e-b955-e7353eccdad4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:35.370126 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2a3fa295-09ee-405e-b955-e7353eccdad4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:35.371408 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2a3fa295-09ee-405e-b955-e7353eccdad4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:35.372827 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2a3fa295-09ee-405e-b955-e7353eccdad4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:35.380627 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=65 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:35.444861 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-ef645c03-8f66-4120-95f5-5e19f5d0f778 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:35.446123 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-ef645c03-8f66-4120-95f5-5e19f5d0f778 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:35.461973 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ef645c03-8f66-4120-95f5-5e19f5d0f778 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:35.462762 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ef645c03-8f66-4120-95f5-5e19f5d0f778 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:35.463953 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ef645c03-8f66-4120-95f5-5e19f5d0f778 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:35.464399 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ef645c03-8f66-4120-95f5-5e19f5d0f778 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:35.706884 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-ef645c03-8f66-4120-95f5-5e19f5d0f778 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:35.716603 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-ef645c03-8f66-4120-95f5-5e19f5d0f778 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66" status: 200 len: 1368 microversion: 2.1 time: 0.276825 Jun 16 00:30:35.719606 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 212/407] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:35 2022] GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 => generated 1368 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:30:35.932405 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-2a3fa295-09ee-405e-b955-e7353eccdad4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:35.942631 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-2a3fa295-09ee-405e-b955-e7353eccdad4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:35.944743 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-2a3fa295-09ee-405e-b955-e7353eccdad4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:35.946236 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-2a3fa295-09ee-405e-b955-e7353eccdad4 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.597982 Jun 16 00:30:35.947330 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 196/408] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:35 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:30:36.735679 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-2a5c28aa-e1d0-4f0e-8b64-1be316cae904 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:36.736283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-2a5c28aa-e1d0-4f0e-8b64-1be316cae904 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:36.749746 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2a5c28aa-e1d0-4f0e-8b64-1be316cae904 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:36.750195 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2a5c28aa-e1d0-4f0e-8b64-1be316cae904 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:36.750963 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2a5c28aa-e1d0-4f0e-8b64-1be316cae904 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:36.751389 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2a5c28aa-e1d0-4f0e-8b64-1be316cae904 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:36.968776 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b20b8d7c-89e5-41f3-a437-5e581d242495 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:36.969530 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-b20b8d7c-89e5-41f3-a437-5e581d242495 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:36.982425 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b20b8d7c-89e5-41f3-a437-5e581d242495 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:36.987092 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b20b8d7c-89e5-41f3-a437-5e581d242495 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:36.989802 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b20b8d7c-89e5-41f3-a437-5e581d242495 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:36.994656 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b20b8d7c-89e5-41f3-a437-5e581d242495 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:37.053221 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-2a5c28aa-e1d0-4f0e-8b64-1be316cae904 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:37.066910 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-2a5c28aa-e1d0-4f0e-8b64-1be316cae904 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66" status: 200 len: 1368 microversion: 2.1 time: 0.334835 Jun 16 00:30:37.074003 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 213/409] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:36 2022] GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 => generated 1368 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:37.331113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b20b8d7c-89e5-41f3-a437-5e581d242495 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:37.347723 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b20b8d7c-89e5-41f3-a437-5e581d242495 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:37.349549 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b20b8d7c-89e5-41f3-a437-5e581d242495 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:37.350985 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-b20b8d7c-89e5-41f3-a437-5e581d242495 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.386631 Jun 16 00:30:37.363496 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 197/410] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:36 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:38.088923 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-9809ea3d-640c-4f69-984c-957adbe3068d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:38.090595 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-9809ea3d-640c-4f69-984c-957adbe3068d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:38.100372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9809ea3d-640c-4f69-984c-957adbe3068d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:38.101124 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9809ea3d-640c-4f69-984c-957adbe3068d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:38.102498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9809ea3d-640c-4f69-984c-957adbe3068d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:38.103086 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9809ea3d-640c-4f69-984c-957adbe3068d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:38.366114 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-9809ea3d-640c-4f69-984c-957adbe3068d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:38.370954 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-a8b222ab-61c4-4d5a-9351-b6753c861234 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:38.372292 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-a8b222ab-61c4-4d5a-9351-b6753c861234 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:38.375241 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-9809ea3d-640c-4f69-984c-957adbe3068d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66" status: 200 len: 1368 microversion: 2.1 time: 0.291723 Jun 16 00:30:38.388557 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 214/411] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:38 2022] GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 => generated 1368 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:38.389100 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a8b222ab-61c4-4d5a-9351-b6753c861234 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:38.389546 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a8b222ab-61c4-4d5a-9351-b6753c861234 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:38.391537 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a8b222ab-61c4-4d5a-9351-b6753c861234 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:38.391966 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a8b222ab-61c4-4d5a-9351-b6753c861234 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:38.750444 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a8b222ab-61c4-4d5a-9351-b6753c861234 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:38.760899 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a8b222ab-61c4-4d5a-9351-b6753c861234 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:38.763247 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a8b222ab-61c4-4d5a-9351-b6753c861234 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:38.765179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-a8b222ab-61c4-4d5a-9351-b6753c861234 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.398991 Jun 16 00:30:38.766388 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 198/412] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:38 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:39.394097 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b19521c9-74ac-477c-8948-5dc35d0b3f01 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:39.395737 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-b19521c9-74ac-477c-8948-5dc35d0b3f01 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:39.405498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b19521c9-74ac-477c-8948-5dc35d0b3f01 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:39.406084 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b19521c9-74ac-477c-8948-5dc35d0b3f01 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:39.407075 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b19521c9-74ac-477c-8948-5dc35d0b3f01 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:39.408998 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b19521c9-74ac-477c-8948-5dc35d0b3f01 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:39.597872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-b19521c9-74ac-477c-8948-5dc35d0b3f01 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:39.609487 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-b19521c9-74ac-477c-8948-5dc35d0b3f01 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66" status: 200 len: 1368 microversion: 2.1 time: 0.219007 Jun 16 00:30:39.610212 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 215/413] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:39 2022] GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:30:39.785366 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-a331cce5-a41e-40f4-8d0b-fb001a74eca9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:39.787316 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-a331cce5-a41e-40f4-8d0b-fb001a74eca9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:39.800354 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a331cce5-a41e-40f4-8d0b-fb001a74eca9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:39.801170 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a331cce5-a41e-40f4-8d0b-fb001a74eca9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:39.802197 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a331cce5-a41e-40f4-8d0b-fb001a74eca9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:39.802797 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a331cce5-a41e-40f4-8d0b-fb001a74eca9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:39.978032 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a331cce5-a41e-40f4-8d0b-fb001a74eca9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:39.987871 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a331cce5-a41e-40f4-8d0b-fb001a74eca9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:39.989430 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a331cce5-a41e-40f4-8d0b-fb001a74eca9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:39.990880 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-a331cce5-a41e-40f4-8d0b-fb001a74eca9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.209674 Jun 16 00:30:39.991615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 199/414] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:39 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:40.632101 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-fca01197-7591-433a-8bfa-c0a2dacbe8b5 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:40.632759 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-fca01197-7591-433a-8bfa-c0a2dacbe8b5 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:40.650274 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fca01197-7591-433a-8bfa-c0a2dacbe8b5 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:40.650863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fca01197-7591-433a-8bfa-c0a2dacbe8b5 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:40.651491 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fca01197-7591-433a-8bfa-c0a2dacbe8b5 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:40.651917 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fca01197-7591-433a-8bfa-c0a2dacbe8b5 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:40.835626 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-fca01197-7591-433a-8bfa-c0a2dacbe8b5 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:40.843237 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-fca01197-7591-433a-8bfa-c0a2dacbe8b5 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66" status: 200 len: 1368 microversion: 2.1 time: 0.220680 Jun 16 00:30:40.843804 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 216/415] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:40 2022] GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:41.010761 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-84a29272-11e9-4e7f-bc0d-fcdf998ae98e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:41.011833 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-84a29272-11e9-4e7f-bc0d-fcdf998ae98e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:41.020945 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-84a29272-11e9-4e7f-bc0d-fcdf998ae98e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:41.021400 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-84a29272-11e9-4e7f-bc0d-fcdf998ae98e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:41.022181 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-84a29272-11e9-4e7f-bc0d-fcdf998ae98e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:41.022609 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-84a29272-11e9-4e7f-bc0d-fcdf998ae98e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:41.163691 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-84a29272-11e9-4e7f-bc0d-fcdf998ae98e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:41.173107 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-84a29272-11e9-4e7f-bc0d-fcdf998ae98e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:41.175804 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-84a29272-11e9-4e7f-bc0d-fcdf998ae98e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:41.177013 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-84a29272-11e9-4e7f-bc0d-fcdf998ae98e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.171057 Jun 16 00:30:41.177597 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 200/416] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:41 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:41.860706 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-263d84b1-8a02-422e-98e9-4271dc5fef28 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:41.861381 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-263d84b1-8a02-422e-98e9-4271dc5fef28 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:41.865456 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=38 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:41.869266 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-263d84b1-8a02-422e-98e9-4271dc5fef28 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:41.869709 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-263d84b1-8a02-422e-98e9-4271dc5fef28 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:41.870471 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-263d84b1-8a02-422e-98e9-4271dc5fef28 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:41.870897 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-263d84b1-8a02-422e-98e9-4271dc5fef28 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:42.021522 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-263d84b1-8a02-422e-98e9-4271dc5fef28 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:42.029304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-263d84b1-8a02-422e-98e9-4271dc5fef28 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66" status: 200 len: 1368 microversion: 2.1 time: 0.173011 Jun 16 00:30:42.030362 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 217/417] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:41 2022] GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:42.196546 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-fc2c1c7a-0c01-40e9-821e-2668a4996fe5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:42.197706 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-fc2c1c7a-0c01-40e9-821e-2668a4996fe5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:42.199707 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=2 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:42.200541 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=8 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:42.210824 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fc2c1c7a-0c01-40e9-821e-2668a4996fe5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:42.211265 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fc2c1c7a-0c01-40e9-821e-2668a4996fe5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:42.212025 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fc2c1c7a-0c01-40e9-821e-2668a4996fe5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:42.212451 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fc2c1c7a-0c01-40e9-821e-2668a4996fe5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:42.360281 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-fc2c1c7a-0c01-40e9-821e-2668a4996fe5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:42.370769 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-fc2c1c7a-0c01-40e9-821e-2668a4996fe5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:42.372438 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-fc2c1c7a-0c01-40e9-821e-2668a4996fe5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:42.373640 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-fc2c1c7a-0c01-40e9-821e-2668a4996fe5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.181383 Jun 16 00:30:42.375497 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 201/418] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:42 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:42.950311 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-54c29cf6-065e-4a68-b230-4118ca3fead5 req-1ccb5d0b-38b4-4d9f-993a-7eebb6c91441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b227643-24e7-44b6-acf7-d3801014a8c7", "name": "network-vif-plugged", "status": "completed", "tag": "c88ef649-3637-4f5d-955c-f88ebc0bb6c5"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:42.960037 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-54c29cf6-065e-4a68-b230-4118ca3fead5 req-1ccb5d0b-38b4-4d9f-993a-7eebb6c91441 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:42.960719 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-54c29cf6-065e-4a68-b230-4118ca3fead5 req-1ccb5d0b-38b4-4d9f-993a-7eebb6c91441 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:42.977198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-54c29cf6-065e-4a68-b230-4118ca3fead5 req-1ccb5d0b-38b4-4d9f-993a-7eebb6c91441 service nova] Creating event network-vif-plugged:c88ef649-3637-4f5d-955c-f88ebc0bb6c5 for instance 6b227643-24e7-44b6-acf7-d3801014a8c7 on hv-cinder-84599 Jun 16 00:30:42.983244 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-54c29cf6-065e-4a68-b230-4118ca3fead5 req-1ccb5d0b-38b4-4d9f-993a-7eebb6c91441 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036385 Jun 16 00:30:42.984632 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 218/419] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:30:43.046617 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-4899800e-f8e5-498c-b2dd-a7511a94b01c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:43.047318 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-4899800e-f8e5-498c-b2dd-a7511a94b01c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:43.056923 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4899800e-f8e5-498c-b2dd-a7511a94b01c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:43.057378 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4899800e-f8e5-498c-b2dd-a7511a94b01c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:43.058192 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4899800e-f8e5-498c-b2dd-a7511a94b01c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:43.058633 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4899800e-f8e5-498c-b2dd-a7511a94b01c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:43.227795 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-4899800e-f8e5-498c-b2dd-a7511a94b01c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:43.237510 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-4899800e-f8e5-498c-b2dd-a7511a94b01c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66" status: 200 len: 1368 microversion: 2.1 time: 0.194531 Jun 16 00:30:43.247618 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 202/420] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:43 2022] GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:43.392051 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-1c530f97-b471-4523-a61d-40ed1ea513bc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:43.393290 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-1c530f97-b471-4523-a61d-40ed1ea513bc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:43.400080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1c530f97-b471-4523-a61d-40ed1ea513bc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:43.400770 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1c530f97-b471-4523-a61d-40ed1ea513bc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:43.401556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1c530f97-b471-4523-a61d-40ed1ea513bc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:43.402129 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1c530f97-b471-4523-a61d-40ed1ea513bc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:43.586328 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-1c530f97-b471-4523-a61d-40ed1ea513bc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:43.597580 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-1c530f97-b471-4523-a61d-40ed1ea513bc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:43.599076 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-1c530f97-b471-4523-a61d-40ed1ea513bc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:43.600231 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-1c530f97-b471-4523-a61d-40ed1ea513bc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.212437 Jun 16 00:30:43.600917 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 219/421] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:43 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:44.255291 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-647159d4-9188-4bc0-910a-d128fda7cf4c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:44.255914 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-647159d4-9188-4bc0-910a-d128fda7cf4c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:44.262684 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-647159d4-9188-4bc0-910a-d128fda7cf4c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:44.263071 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-647159d4-9188-4bc0-910a-d128fda7cf4c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:44.263832 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-647159d4-9188-4bc0-910a-d128fda7cf4c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:44.264269 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-647159d4-9188-4bc0-910a-d128fda7cf4c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:44.405266 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-647159d4-9188-4bc0-910a-d128fda7cf4c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:44.414259 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-647159d4-9188-4bc0-910a-d128fda7cf4c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66" status: 200 len: 1368 microversion: 2.1 time: 0.163332 Jun 16 00:30:44.414925 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 203/422] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:44 2022] GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:44.538143 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-e9ce4503-0546-43e0-a726-87b1d01d7b62 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Action: 'create', calling method: .version_select at 0x7fe704d57670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-436131327", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7U57FfNMilAdY4rXtAmGUlV0kJwjKe7AcGeXXJeQW0Bahu7DtVdaCQB9IAbKb4MT/NKZdcWxIT0F8ukqF18Wt8S4Jw+uBnuRiSwlzuWt3XEPCJMuOdYBNnTbjnEdmYww=="}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:44.552746 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-e9ce4503-0546-43e0-a726-87b1d01d7b62 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Getting quotas for project 87ac732ab7df406c933081dd4939ae1e. Resources: {'key_pairs'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:30:44.556606 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-e9ce4503-0546-43e0-a726-87b1d01d7b62 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Getting quotas for user a5d4beaae81b4b8b9e4057f012d18b8b and project 87ac732ab7df406c933081dd4939ae1e. Resources: {'key_pairs'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:30:44.578782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-e9ce4503-0546-43e0-a726-87b1d01d7b62 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.044407 Jun 16 00:30:44.579365 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 220/423] 10.222.0.23 () {60 vars in 1158 bytes} [Thu Jun 16 00:30:44 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:30:44.617928 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-6b5ac7ac-135e-4de8-be93-53881aa0fd60 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:44.618532 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-6b5ac7ac-135e-4de8-be93-53881aa0fd60 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:44.624497 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6b5ac7ac-135e-4de8-be93-53881aa0fd60 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:44.624970 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6b5ac7ac-135e-4de8-be93-53881aa0fd60 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:44.625833 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6b5ac7ac-135e-4de8-be93-53881aa0fd60 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:44.626368 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6b5ac7ac-135e-4de8-be93-53881aa0fd60 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:44.684466 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-cf65bac8-d844-429b-9586-4d3d4b541f7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1299300467", "imageRef": "9c399877-3b34-4deb-bb10-a25d626da234", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-436131327", "networks": [{"uuid": "79f91266-d0f0-43be-ad46-7bdc5f0fa087"}]}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:44.739834 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.network.neutron [None req-cf65bac8-d844-429b-9586-4d3d4b541f7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] validate_networks() for [('79f91266-d0f0-43be-ad46-7bdc5f0fa087', None, None, None, None, None)] {{(pid=124231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:30:44.763121 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-6b5ac7ac-135e-4de8-be93-53881aa0fd60 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:44.772656 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-6b5ac7ac-135e-4de8-be93-53881aa0fd60 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:44.774106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-6b5ac7ac-135e-4de8-be93-53881aa0fd60 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:44.775244 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-6b5ac7ac-135e-4de8-be93-53881aa0fd60 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.161320 Jun 16 00:30:44.775792 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 204/424] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:44 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:45.035219 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-c82188d9-eeed-4baa-a7d7-cbf3095a1b61 req-8456d541-5c08-406f-9913-deecfedd1084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52832e7d-aae4-4a38-81ec-e84727dd8d66", "name": "network-vif-plugged", "status": "completed", "tag": "5485f1e1-4a63-42e1-96bc-20193c388b65"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:45.043255 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-c82188d9-eeed-4baa-a7d7-cbf3095a1b61 req-8456d541-5c08-406f-9913-deecfedd1084 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:45.043764 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-c82188d9-eeed-4baa-a7d7-cbf3095a1b61 req-8456d541-5c08-406f-9913-deecfedd1084 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:45.055434 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-c82188d9-eeed-4baa-a7d7-cbf3095a1b61 req-8456d541-5c08-406f-9913-deecfedd1084 service nova] Creating event network-vif-plugged:5485f1e1-4a63-42e1-96bc-20193c388b65 for instance 52832e7d-aae4-4a38-81ec-e84727dd8d66 on hv-cinder-84599 Jun 16 00:30:45.060468 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-c82188d9-eeed-4baa-a7d7-cbf3095a1b61 req-8456d541-5c08-406f-9913-deecfedd1084 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028872 Jun 16 00:30:45.061090 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 205/425] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:30:45.109683 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-cf65bac8-d844-429b-9586-4d3d4b541f7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Flavor limits 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:30:45.110103 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-cf65bac8-d844-429b-9586-4d3d4b541f7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Image limits 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:30:45.110570 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-cf65bac8-d844-429b-9586-4d3d4b541f7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Flavor pref 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:30:45.110975 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-cf65bac8-d844-429b-9586-4d3d4b541f7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Image pref 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:30:45.112399 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-cf65bac8-d844-429b-9586-4d3d4b541f7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:30:45.121154 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cf65bac8-d844-429b-9586-4d3d4b541f7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:45.121595 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cf65bac8-d844-429b-9586-4d3d4b541f7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:45.122385 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cf65bac8-d844-429b-9586-4d3d4b541f7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:45.122811 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cf65bac8-d844-429b-9586-4d3d4b541f7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:45.139797 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-cf65bac8-d844-429b-9586-4d3d4b541f7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Getting quotas for project 87ac732ab7df406c933081dd4939ae1e. Resources: {'ram', 'cores', 'instances'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:30:45.144213 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-cf65bac8-d844-429b-9586-4d3d4b541f7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Getting quotas for user a5d4beaae81b4b8b9e4057f012d18b8b and project 87ac732ab7df406c933081dd4939ae1e. Resources: {'ram', 'cores', 'instances'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:30:45.155095 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-cf65bac8-d844-429b-9586-4d3d4b541f7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Going to run 1 instances... {{(pid=124231) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:30:45.157267 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-cf65bac8-d844-429b-9586-4d3d4b541f7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c399877-3b34-4deb-bb10-a25d626da234',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:30:45.203811 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-cf65bac8-d844-429b-9586-4d3d4b541f7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.523281 Jun 16 00:30:45.204444 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 221/426] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Jun 16 00:30:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 00:30:45.214903 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-25152763-cd0b-4f8a-8d9f-67beaf706e3e tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:45.215605 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-25152763-cd0b-4f8a-8d9f-67beaf706e3e tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:45.275829 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-25152763-cd0b-4f8a-8d9f-67beaf706e3e tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:45.283999 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-25152763-cd0b-4f8a-8d9f-67beaf706e3e tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1258 microversion: 2.1 time: 0.072382 Jun 16 00:30:45.285131 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 206/427] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:45 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:45.433976 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-7da1b5eb-2be2-4426-bca8-940ddd235b2b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:45.434849 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-7da1b5eb-2be2-4426-bca8-940ddd235b2b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:45.447768 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7da1b5eb-2be2-4426-bca8-940ddd235b2b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:45.448356 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7da1b5eb-2be2-4426-bca8-940ddd235b2b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:45.449277 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7da1b5eb-2be2-4426-bca8-940ddd235b2b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:45.449714 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7da1b5eb-2be2-4426-bca8-940ddd235b2b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:45.602334 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-7da1b5eb-2be2-4426-bca8-940ddd235b2b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:45.612471 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-7da1b5eb-2be2-4426-bca8-940ddd235b2b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66" status: 200 len: 1368 microversion: 2.1 time: 0.184699 Jun 16 00:30:45.613285 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 222/428] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:45 2022] GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:45.793662 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-0f64fe5d-efc4-4456-b8ac-8802dc1f3e8b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:45.794292 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-0f64fe5d-efc4-4456-b8ac-8802dc1f3e8b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:45.802100 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0f64fe5d-efc4-4456-b8ac-8802dc1f3e8b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:45.802556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0f64fe5d-efc4-4456-b8ac-8802dc1f3e8b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:45.803394 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0f64fe5d-efc4-4456-b8ac-8802dc1f3e8b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:45.803816 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0f64fe5d-efc4-4456-b8ac-8802dc1f3e8b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:45.970953 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0f64fe5d-efc4-4456-b8ac-8802dc1f3e8b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:45.983273 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0f64fe5d-efc4-4456-b8ac-8802dc1f3e8b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:45.983273 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0f64fe5d-efc4-4456-b8ac-8802dc1f3e8b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:45.983954 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-0f64fe5d-efc4-4456-b8ac-8802dc1f3e8b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1809 microversion: 2.20 time: 0.194209 Jun 16 00:30:45.984675 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 207/429] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:45 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:46.301615 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-90f158cd-e51b-4a55-aba3-84ad4c8fe36f tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:46.302217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-90f158cd-e51b-4a55-aba3-84ad4c8fe36f tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:46.308268 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-90f158cd-e51b-4a55-aba3-84ad4c8fe36f tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:46.308717 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-90f158cd-e51b-4a55-aba3-84ad4c8fe36f tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:46.309497 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-90f158cd-e51b-4a55-aba3-84ad4c8fe36f tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:46.309929 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-90f158cd-e51b-4a55-aba3-84ad4c8fe36f tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:46.375991 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-90f158cd-e51b-4a55-aba3-84ad4c8fe36f tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:46.383372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-90f158cd-e51b-4a55-aba3-84ad4c8fe36f tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1310 microversion: 2.1 time: 0.085574 Jun 16 00:30:46.383927 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 223/430] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:46 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:46.629714 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b9540de8-221a-45da-abed-5f65ab346de5 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:46.630277 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-b9540de8-221a-45da-abed-5f65ab346de5 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:46.636716 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b9540de8-221a-45da-abed-5f65ab346de5 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:46.637203 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b9540de8-221a-45da-abed-5f65ab346de5 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:46.637982 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b9540de8-221a-45da-abed-5f65ab346de5 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:46.638420 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b9540de8-221a-45da-abed-5f65ab346de5 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:46.775166 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b9540de8-221a-45da-abed-5f65ab346de5 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:46.782545 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-b9540de8-221a-45da-abed-5f65ab346de5 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66" status: 200 len: 1368 microversion: 2.1 time: 0.156941 Jun 16 00:30:46.783146 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 208/431] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:46 2022] GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:30:47.003638 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-7fa23764-3f4c-443a-b94e-31d27752b9a8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:47.004144 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-7fa23764-3f4c-443a-b94e-31d27752b9a8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:47.010854 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7fa23764-3f4c-443a-b94e-31d27752b9a8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:47.011295 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7fa23764-3f4c-443a-b94e-31d27752b9a8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:47.012047 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7fa23764-3f4c-443a-b94e-31d27752b9a8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:47.012478 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7fa23764-3f4c-443a-b94e-31d27752b9a8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:47.147805 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-7fa23764-3f4c-443a-b94e-31d27752b9a8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:47.159595 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-7fa23764-3f4c-443a-b94e-31d27752b9a8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:47.161114 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-7fa23764-3f4c-443a-b94e-31d27752b9a8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:47.162407 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-7fa23764-3f4c-443a-b94e-31d27752b9a8 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1796 microversion: 2.20 time: 0.163028 Jun 16 00:30:47.163300 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 224/432] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:46 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1796 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:47.400434 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-9a63c9a6-9870-435a-a354-60af85240bf2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:47.401139 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-9a63c9a6-9870-435a-a354-60af85240bf2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:47.407117 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9a63c9a6-9870-435a-a354-60af85240bf2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:47.407563 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9a63c9a6-9870-435a-a354-60af85240bf2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:47.409172 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9a63c9a6-9870-435a-a354-60af85240bf2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:47.409607 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9a63c9a6-9870-435a-a354-60af85240bf2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:47.471254 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-9a63c9a6-9870-435a-a354-60af85240bf2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:47.478565 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-9a63c9a6-9870-435a-a354-60af85240bf2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1318 microversion: 2.1 time: 0.082015 Jun 16 00:30:47.479125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 209/433] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:47 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1318 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:47.800114 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-bff10017-18d1-49c8-9e35-32b08f1d1c8f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:47.800821 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-bff10017-18d1-49c8-9e35-32b08f1d1c8f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:47.806990 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-bff10017-18d1-49c8-9e35-32b08f1d1c8f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:47.807437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-bff10017-18d1-49c8-9e35-32b08f1d1c8f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:47.808207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-bff10017-18d1-49c8-9e35-32b08f1d1c8f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:47.808641 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-bff10017-18d1-49c8-9e35-32b08f1d1c8f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:47.947807 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-bff10017-18d1-49c8-9e35-32b08f1d1c8f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:47.955608 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-bff10017-18d1-49c8-9e35-32b08f1d1c8f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66" status: 200 len: 1557 microversion: 2.1 time: 0.159561 Jun 16 00:30:47.955802 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 225/434] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:47 2022] GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:47.972360 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-0d5c2353-741f-4277-aa38-e090c1f449c2 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:47.972838 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-0d5c2353-741f-4277-aa38-e090c1f449c2 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:47.975467 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:47.981908 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0d5c2353-741f-4277-aa38-e090c1f449c2 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:47.982347 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0d5c2353-741f-4277-aa38-e090c1f449c2 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:47.983290 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0d5c2353-741f-4277-aa38-e090c1f449c2 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:47.983883 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0d5c2353-741f-4277-aa38-e090c1f449c2 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:48.101355 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-0d5c2353-741f-4277-aa38-e090c1f449c2 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132751 Jun 16 00:30:48.102510 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 210/435] 10.222.0.23 () {58 vars in 1274 bytes} [Thu Jun 16 00:30:47 2022] GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:30:48.495462 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-4d3d5c46-7d20-47d3-8105-f20e5607ccbb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:48.496783 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-4d3d5c46-7d20-47d3-8105-f20e5607ccbb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:48.510366 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4d3d5c46-7d20-47d3-8105-f20e5607ccbb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:48.511177 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4d3d5c46-7d20-47d3-8105-f20e5607ccbb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:48.512348 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4d3d5c46-7d20-47d3-8105-f20e5607ccbb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:48.512996 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4d3d5c46-7d20-47d3-8105-f20e5607ccbb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:49.265222 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-4d3d5c46-7d20-47d3-8105-f20e5607ccbb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:49.285878 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-4d3d5c46-7d20-47d3-8105-f20e5607ccbb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1358 microversion: 2.1 time: 0.794145 Jun 16 00:30:49.286459 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 226/436] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:48 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1358 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:49.790684 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-d77603b3-3650-47fc-a338-95f44797cc83 req-0c3df8d0-d661-4d6b-aead-bede6de14155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52832e7d-aae4-4a38-81ec-e84727dd8d66", "tag": "5485f1e1-4a63-42e1-96bc-20193c388b65"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:49.804547 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-d77603b3-3650-47fc-a338-95f44797cc83 req-0c3df8d0-d661-4d6b-aead-bede6de14155 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:49.806929 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-d77603b3-3650-47fc-a338-95f44797cc83 req-0c3df8d0-d661-4d6b-aead-bede6de14155 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:49.821998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-d77603b3-3650-47fc-a338-95f44797cc83 req-0c3df8d0-d661-4d6b-aead-bede6de14155 service nova] Creating event network-changed:5485f1e1-4a63-42e1-96bc-20193c388b65 for instance 52832e7d-aae4-4a38-81ec-e84727dd8d66 on hv-cinder-84599 Jun 16 00:30:49.827432 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-d77603b3-3650-47fc-a338-95f44797cc83 req-0c3df8d0-d661-4d6b-aead-bede6de14155 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040246 Jun 16 00:30:49.828064 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 211/437] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:30:50.303357 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-9312873e-b9ed-4891-8af2-2379def1f5c9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:50.304847 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-9312873e-b9ed-4891-8af2-2379def1f5c9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:50.318817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9312873e-b9ed-4891-8af2-2379def1f5c9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:50.319791 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9312873e-b9ed-4891-8af2-2379def1f5c9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:50.321338 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9312873e-b9ed-4891-8af2-2379def1f5c9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:50.322067 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9312873e-b9ed-4891-8af2-2379def1f5c9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:50.481375 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-9312873e-b9ed-4891-8af2-2379def1f5c9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:50.490242 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-9312873e-b9ed-4891-8af2-2379def1f5c9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1358 microversion: 2.1 time: 0.190870 Jun 16 00:30:50.490826 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 227/438] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:50 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:30:51.508288 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-a3021718-030b-4977-ab1c-2a07065777e8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:51.509033 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-a3021718-030b-4977-ab1c-2a07065777e8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:51.515362 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a3021718-030b-4977-ab1c-2a07065777e8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:51.515808 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a3021718-030b-4977-ab1c-2a07065777e8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:51.516628 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a3021718-030b-4977-ab1c-2a07065777e8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:51.517599 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a3021718-030b-4977-ab1c-2a07065777e8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:51.677406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a3021718-030b-4977-ab1c-2a07065777e8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:51.684985 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-a3021718-030b-4977-ab1c-2a07065777e8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1358 microversion: 2.1 time: 0.181523 Jun 16 00:30:51.685547 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 212/439] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:51 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:52.328491 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-4c528133-053a-4b71-8bc8-b8b5f7cf16a7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff5b4ce4-bc3f-41ae-9d82-2a0ab8b6e15d"}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:52.330335 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-4c528133-053a-4b71-8bc8-b8b5f7cf16a7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:52.336958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4c528133-053a-4b71-8bc8-b8b5f7cf16a7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:52.337621 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4c528133-053a-4b71-8bc8-b8b5f7cf16a7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:52.338573 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4c528133-053a-4b71-8bc8-b8b5f7cf16a7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:52.339004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4c528133-053a-4b71-8bc8-b8b5f7cf16a7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:52.413820 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=100 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:52.701888 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b2c87865-5490-4681-8e6d-76ceb85fda54 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:52.702622 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-b2c87865-5490-4681-8e6d-76ceb85fda54 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:52.710549 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b2c87865-5490-4681-8e6d-76ceb85fda54 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:52.710992 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b2c87865-5490-4681-8e6d-76ceb85fda54 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:52.711753 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b2c87865-5490-4681-8e6d-76ceb85fda54 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:52.712185 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b2c87865-5490-4681-8e6d-76ceb85fda54 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:52.857945 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b2c87865-5490-4681-8e6d-76ceb85fda54 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:52.865635 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-b2c87865-5490-4681-8e6d-76ceb85fda54 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1358 microversion: 2.1 time: 0.167604 Jun 16 00:30:52.866407 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 213/440] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:52 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:30:53.883042 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-2f1cfbed-c66a-4f16-aa71-a3e7f7fc5810 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:53.883901 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-2f1cfbed-c66a-4f16-aa71-a3e7f7fc5810 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:53.889778 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2f1cfbed-c66a-4f16-aa71-a3e7f7fc5810 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:53.890220 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2f1cfbed-c66a-4f16-aa71-a3e7f7fc5810 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:53.891004 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2f1cfbed-c66a-4f16-aa71-a3e7f7fc5810 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:53.891409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2f1cfbed-c66a-4f16-aa71-a3e7f7fc5810 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:54.031481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-2f1cfbed-c66a-4f16-aa71-a3e7f7fc5810 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:54.039633 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-2f1cfbed-c66a-4f16-aa71-a3e7f7fc5810 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1358 microversion: 2.1 time: 0.160471 Jun 16 00:30:54.040206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 214/441] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:53 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:30:55.057095 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-91df3d78-189f-449b-a33b-ea74187f0bb6 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:55.057829 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-91df3d78-189f-449b-a33b-ea74187f0bb6 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:55.065047 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-91df3d78-189f-449b-a33b-ea74187f0bb6 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:55.065494 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-91df3d78-189f-449b-a33b-ea74187f0bb6 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:55.066258 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-91df3d78-189f-449b-a33b-ea74187f0bb6 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:55.066683 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-91df3d78-189f-449b-a33b-ea74187f0bb6 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:55.083942 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=100 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:55.131448 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=2 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:55.150579 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=10 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:55.203400 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-91df3d78-189f-449b-a33b-ea74187f0bb6 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:55.210981 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-91df3d78-189f-449b-a33b-ea74187f0bb6 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1358 microversion: 2.1 time: 0.157818 Jun 16 00:30:55.211729 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 215/442] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:55 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:30:56.227810 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-577022ba-74d0-4c41-a8ad-6f6be5a0cd8c tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:56.228445 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-577022ba-74d0-4c41-a8ad-6f6be5a0cd8c tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:56.230312 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=2 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:56.236331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-577022ba-74d0-4c41-a8ad-6f6be5a0cd8c tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:56.236856 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-577022ba-74d0-4c41-a8ad-6f6be5a0cd8c tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:56.237714 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-577022ba-74d0-4c41-a8ad-6f6be5a0cd8c tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:56.238212 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-577022ba-74d0-4c41-a8ad-6f6be5a0cd8c tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:56.405234 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-577022ba-74d0-4c41-a8ad-6f6be5a0cd8c tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:56.413399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-577022ba-74d0-4c41-a8ad-6f6be5a0cd8c tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1358 microversion: 2.1 time: 0.189636 Jun 16 00:30:56.413958 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 216/443] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:56 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:30:57.132205 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-4c528133-053a-4b71-8bc8-b8b5f7cf16a7 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "POST /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.807490 Jun 16 00:30:57.133190 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 228/444] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Jun 16 00:30:52 2022] POST /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe/os-volume_attachments => generated 194 bytes in 4809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:30:57.430819 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-822896b9-0617-4d51-a13e-6b9abe01ca83 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:57.431422 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-822896b9-0617-4d51-a13e-6b9abe01ca83 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:57.437792 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-822896b9-0617-4d51-a13e-6b9abe01ca83 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:57.438230 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-822896b9-0617-4d51-a13e-6b9abe01ca83 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:57.439083 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-822896b9-0617-4d51-a13e-6b9abe01ca83 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:57.439506 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-822896b9-0617-4d51-a13e-6b9abe01ca83 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:57.990094 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-822896b9-0617-4d51-a13e-6b9abe01ca83 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:57.998109 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-822896b9-0617-4d51-a13e-6b9abe01ca83 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1358 microversion: 2.1 time: 0.571157 Jun 16 00:30:57.998682 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 217/445] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:57 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1358 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:58.299024 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-a51d3754-479e-447a-930c-81fa501a6fb7 req-47349a00-d00c-49e0-9754-d6b4c739b1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0750226-e65f-4cfc-94df-46f38bbd623c", "tag": "cff9c087-7e00-4554-b1a9-538c7504d332"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:58.320707 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-a51d3754-479e-447a-930c-81fa501a6fb7 req-47349a00-d00c-49e0-9754-d6b4c739b1f8 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:58.321309 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-a51d3754-479e-447a-930c-81fa501a6fb7 req-47349a00-d00c-49e0-9754-d6b4c739b1f8 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:58.337976 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-a51d3754-479e-447a-930c-81fa501a6fb7 req-47349a00-d00c-49e0-9754-d6b4c739b1f8 service nova] Creating event network-changed:cff9c087-7e00-4554-b1a9-538c7504d332 for instance c0750226-e65f-4cfc-94df-46f38bbd623c on hv-cinder-84599 Jun 16 00:30:58.343276 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-a51d3754-479e-447a-930c-81fa501a6fb7 req-47349a00-d00c-49e0-9754-d6b4c739b1f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049571 Jun 16 00:30:58.344259 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 229/446] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:30:59.015891 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-1a937398-f12f-4839-99e2-17750434a37a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:59.016421 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-1a937398-f12f-4839-99e2-17750434a37a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:59.023734 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1a937398-f12f-4839-99e2-17750434a37a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:59.024172 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1a937398-f12f-4839-99e2-17750434a37a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:59.024951 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1a937398-f12f-4839-99e2-17750434a37a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:59.025400 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1a937398-f12f-4839-99e2-17750434a37a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:59.152323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-1a937398-f12f-4839-99e2-17750434a37a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:59.160714 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-1a937398-f12f-4839-99e2-17750434a37a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1358 microversion: 2.1 time: 0.148756 Jun 16 00:30:59.161332 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 218/447] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:59 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:00.234747 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-a944d852-a808-4c83-bab0-4108cece5086 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:00.236096 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-a944d852-a808-4c83-bab0-4108cece5086 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:00.242901 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a944d852-a808-4c83-bab0-4108cece5086 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:00.243343 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a944d852-a808-4c83-bab0-4108cece5086 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:00.244090 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a944d852-a808-4c83-bab0-4108cece5086 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:00.244518 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a944d852-a808-4c83-bab0-4108cece5086 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:00.373253 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-a944d852-a808-4c83-bab0-4108cece5086 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:00.381101 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-a944d852-a808-4c83-bab0-4108cece5086 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1358 microversion: 2.1 time: 0.150499 Jun 16 00:31:00.381652 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 230/448] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:00 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:01.397981 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-a6b69c6d-52d6-41e3-9949-d156ae03a6a2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:01.398592 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-a6b69c6d-52d6-41e3-9949-d156ae03a6a2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:01.405595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a6b69c6d-52d6-41e3-9949-d156ae03a6a2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:01.406085 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a6b69c6d-52d6-41e3-9949-d156ae03a6a2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:01.406839 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a6b69c6d-52d6-41e3-9949-d156ae03a6a2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:01.407577 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a6b69c6d-52d6-41e3-9949-d156ae03a6a2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:01.540583 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a6b69c6d-52d6-41e3-9949-d156ae03a6a2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:01.548429 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-a6b69c6d-52d6-41e3-9949-d156ae03a6a2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1358 microversion: 2.1 time: 0.154019 Jun 16 00:31:01.549126 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 219/449] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:01 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:02.565551 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-342fe8e6-d852-4d8c-804f-5d5f84378018 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:02.566201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-342fe8e6-d852-4d8c-804f-5d5f84378018 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:02.572895 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-342fe8e6-d852-4d8c-804f-5d5f84378018 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:02.573350 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-342fe8e6-d852-4d8c-804f-5d5f84378018 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:02.574104 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-342fe8e6-d852-4d8c-804f-5d5f84378018 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:02.574537 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-342fe8e6-d852-4d8c-804f-5d5f84378018 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:02.706860 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-342fe8e6-d852-4d8c-804f-5d5f84378018 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:02.714608 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-342fe8e6-d852-4d8c-804f-5d5f84378018 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1358 microversion: 2.1 time: 0.153546 Jun 16 00:31:02.715168 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 231/450] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:02 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:03.731584 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-be1e92e8-3e02-45a1-ac8b-b41739724c24 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:03.732194 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-be1e92e8-3e02-45a1-ac8b-b41739724c24 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:03.738957 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-be1e92e8-3e02-45a1-ac8b-b41739724c24 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:03.739406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-be1e92e8-3e02-45a1-ac8b-b41739724c24 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:03.740166 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-be1e92e8-3e02-45a1-ac8b-b41739724c24 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:03.740597 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-be1e92e8-3e02-45a1-ac8b-b41739724c24 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:03.876743 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-be1e92e8-3e02-45a1-ac8b-b41739724c24 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:03.884415 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-be1e92e8-3e02-45a1-ac8b-b41739724c24 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1358 microversion: 2.1 time: 0.156803 Jun 16 00:31:03.884996 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 220/451] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:03 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:04.633523 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-c9bbd03f-b3c0-4b5b-8c4c-7ee1f54bdd23 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:04.635026 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-c9bbd03f-b3c0-4b5b-8c4c-7ee1f54bdd23 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:04.642103 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c9bbd03f-b3c0-4b5b-8c4c-7ee1f54bdd23 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:04.642546 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c9bbd03f-b3c0-4b5b-8c4c-7ee1f54bdd23 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:04.643314 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c9bbd03f-b3c0-4b5b-8c4c-7ee1f54bdd23 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:04.643742 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c9bbd03f-b3c0-4b5b-8c4c-7ee1f54bdd23 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:04.667530 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.objects.instance [None req-c9bbd03f-b3c0-4b5b-8c4c-7ee1f54bdd23 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lazy-loading 'flavor' on Instance uuid 8298735b-2311-40d2-9261-ba64afe3b7fe {{(pid=124231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:31:04.791611 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-c9bbd03f-b3c0-4b5b-8c4c-7ee1f54bdd23 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "POST /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe/action" status: 200 len: 32 microversion: 2.1 time: 0.161801 Jun 16 00:31:04.792231 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 232/452] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Jun 16 00:31:04 2022] POST /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:31:04.801792 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5f715f72-5663-4220-b879-f0456facce96 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:04.802394 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-5f715f72-5663-4220-b879-f0456facce96 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:04.809032 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5f715f72-5663-4220-b879-f0456facce96 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:04.809789 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5f715f72-5663-4220-b879-f0456facce96 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:04.810617 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5f715f72-5663-4220-b879-f0456facce96 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:04.811066 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5f715f72-5663-4220-b879-f0456facce96 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:04.902407 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-cae9f5b0-035a-42ba-bf17-1f407e409cd4 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:04.903110 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-cae9f5b0-035a-42ba-bf17-1f407e409cd4 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:04.910179 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cae9f5b0-035a-42ba-bf17-1f407e409cd4 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:04.910634 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cae9f5b0-035a-42ba-bf17-1f407e409cd4 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:04.911411 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cae9f5b0-035a-42ba-bf17-1f407e409cd4 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:04.911842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cae9f5b0-035a-42ba-bf17-1f407e409cd4 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:05.032535 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-5f715f72-5663-4220-b879-f0456facce96 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:05.042036 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-5f715f72-5663-4220-b879-f0456facce96 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1735 microversion: 2.1 time: 0.244599 Jun 16 00:31:05.043686 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 221/453] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:04 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1735 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:05.081343 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-cae9f5b0-035a-42ba-bf17-1f407e409cd4 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:05.089596 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-cae9f5b0-035a-42ba-bf17-1f407e409cd4 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1358 microversion: 2.1 time: 0.191463 Jun 16 00:31:05.090354 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 233/454] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:04 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:31:05.113492 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-d40ab25f-dabf-4ee6-bf69-359b1f6c3ba0 req-38f02d09-5930-489f-8eb8-7e48ffe4c282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0750226-e65f-4cfc-94df-46f38bbd623c", "name": "network-vif-plugged", "status": "completed", "tag": "cff9c087-7e00-4554-b1a9-538c7504d332"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:05.121698 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-d40ab25f-dabf-4ee6-bf69-359b1f6c3ba0 req-38f02d09-5930-489f-8eb8-7e48ffe4c282 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:05.122145 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-d40ab25f-dabf-4ee6-bf69-359b1f6c3ba0 req-38f02d09-5930-489f-8eb8-7e48ffe4c282 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:05.134738 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-d40ab25f-dabf-4ee6-bf69-359b1f6c3ba0 req-38f02d09-5930-489f-8eb8-7e48ffe4c282 service nova] Creating event network-vif-plugged:cff9c087-7e00-4554-b1a9-538c7504d332 for instance c0750226-e65f-4cfc-94df-46f38bbd623c on hv-cinder-84599 Jun 16 00:31:05.140484 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-d40ab25f-dabf-4ee6-bf69-359b1f6c3ba0 req-38f02d09-5930-489f-8eb8-7e48ffe4c282 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031295 Jun 16 00:31:05.141131 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 222/455] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:31:06.059598 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-02ad7ab0-5d22-4181-bd90-ea47395b2995 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:06.060137 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-02ad7ab0-5d22-4181-bd90-ea47395b2995 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:06.068140 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-02ad7ab0-5d22-4181-bd90-ea47395b2995 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:06.068578 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-02ad7ab0-5d22-4181-bd90-ea47395b2995 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:06.069360 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-02ad7ab0-5d22-4181-bd90-ea47395b2995 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:06.069786 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-02ad7ab0-5d22-4181-bd90-ea47395b2995 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:06.107390 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-96d5af76-7ae0-454a-a390-8b22db85c6f9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:06.108117 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-96d5af76-7ae0-454a-a390-8b22db85c6f9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:06.115037 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-96d5af76-7ae0-454a-a390-8b22db85c6f9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:06.115490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-96d5af76-7ae0-454a-a390-8b22db85c6f9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:06.116259 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-96d5af76-7ae0-454a-a390-8b22db85c6f9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:06.116688 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-96d5af76-7ae0-454a-a390-8b22db85c6f9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:06.210043 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-02ad7ab0-5d22-4181-bd90-ea47395b2995 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:06.217998 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-02ad7ab0-5d22-4181-bd90-ea47395b2995 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1735 microversion: 2.1 time: 0.162364 Jun 16 00:31:06.218661 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 234/456] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:06 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:06.252173 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-96d5af76-7ae0-454a-a390-8b22db85c6f9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:06.259485 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-96d5af76-7ae0-454a-a390-8b22db85c6f9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1358 microversion: 2.1 time: 0.156695 Jun 16 00:31:06.260041 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 223/457] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:06 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:31:07.235670 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-8a33d867-f045-4411-bb2b-bd1c6e6e670e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:07.236279 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-8a33d867-f045-4411-bb2b-bd1c6e6e670e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:07.242786 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8a33d867-f045-4411-bb2b-bd1c6e6e670e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:07.243231 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8a33d867-f045-4411-bb2b-bd1c6e6e670e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:07.243982 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8a33d867-f045-4411-bb2b-bd1c6e6e670e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:07.244504 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8a33d867-f045-4411-bb2b-bd1c6e6e670e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:07.277792 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-9ce77600-1ea8-418c-a398-51fc827f6032 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:07.279061 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-9ce77600-1ea8-418c-a398-51fc827f6032 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:07.287793 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9ce77600-1ea8-418c-a398-51fc827f6032 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:07.288476 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9ce77600-1ea8-418c-a398-51fc827f6032 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:07.289346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9ce77600-1ea8-418c-a398-51fc827f6032 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:07.290054 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9ce77600-1ea8-418c-a398-51fc827f6032 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:07.386011 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-8a33d867-f045-4411-bb2b-bd1c6e6e670e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:07.394085 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-8a33d867-f045-4411-bb2b-bd1c6e6e670e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1735 microversion: 2.1 time: 0.162757 Jun 16 00:31:07.394650 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 235/458] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:07 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:07.435645 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-9ce77600-1ea8-418c-a398-51fc827f6032 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:07.445161 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-9ce77600-1ea8-418c-a398-51fc827f6032 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1358 microversion: 2.1 time: 0.171152 Jun 16 00:31:07.445714 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 224/459] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:07 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:08.415756 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-5d3db8e4-1122-4eb8-bf49-ccf05a5062fb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:08.416465 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-5d3db8e4-1122-4eb8-bf49-ccf05a5062fb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:08.425220 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5d3db8e4-1122-4eb8-bf49-ccf05a5062fb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:08.425777 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5d3db8e4-1122-4eb8-bf49-ccf05a5062fb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:08.426563 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5d3db8e4-1122-4eb8-bf49-ccf05a5062fb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:08.427255 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5d3db8e4-1122-4eb8-bf49-ccf05a5062fb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:08.461984 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-1b914ad8-d2ee-4a52-977f-1005f4705af2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:08.462753 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-1b914ad8-d2ee-4a52-977f-1005f4705af2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:08.469642 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1b914ad8-d2ee-4a52-977f-1005f4705af2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:08.470181 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1b914ad8-d2ee-4a52-977f-1005f4705af2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:08.470950 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1b914ad8-d2ee-4a52-977f-1005f4705af2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:08.471388 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1b914ad8-d2ee-4a52-977f-1005f4705af2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:08.574816 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-5d3db8e4-1122-4eb8-bf49-ccf05a5062fb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:08.583993 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-5d3db8e4-1122-4eb8-bf49-ccf05a5062fb tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1735 microversion: 2.1 time: 0.173082 Jun 16 00:31:08.585065 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 236/460] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:08 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:08.605632 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-1b914ad8-d2ee-4a52-977f-1005f4705af2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:08.613431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-1b914ad8-d2ee-4a52-977f-1005f4705af2 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1548 microversion: 2.1 time: 0.155143 Jun 16 00:31:08.613924 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 225/461] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:08 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:31:08.631799 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-6b50e4d2-65b8-46c6-ab05-cce4fe37f5f7 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:08.632408 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-6b50e4d2-65b8-46c6-ab05-cce4fe37f5f7 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:08.638334 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6b50e4d2-65b8-46c6-ab05-cce4fe37f5f7 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:08.638769 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6b50e4d2-65b8-46c6-ab05-cce4fe37f5f7 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:08.639511 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6b50e4d2-65b8-46c6-ab05-cce4fe37f5f7 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:08.639936 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6b50e4d2-65b8-46c6-ab05-cce4fe37f5f7 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:08.772199 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-6b50e4d2-65b8-46c6-ab05-cce4fe37f5f7 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:08.779763 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-6b50e4d2-65b8-46c6-ab05-cce4fe37f5f7 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1548 microversion: 2.1 time: 0.153296 Jun 16 00:31:08.780325 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 237/462] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:08 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:08.795739 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-cc855943-3d42-431f-870d-df5205812a4d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:08.799648 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-cc855943-3d42-431f-870d-df5205812a4d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:08.800405 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-cc855943-3d42-431f-870d-df5205812a4d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Searching by: {'deleted': False, 'project_id': '87ac732ab7df406c933081dd4939ae1e'} {{(pid=124230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 00:31:08.808764 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-cc855943-3d42-431f-870d-df5205812a4d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:08.809255 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-cc855943-3d42-431f-870d-df5205812a4d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:08.810086 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-cc855943-3d42-431f-870d-df5205812a4d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:08.810524 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-cc855943-3d42-431f-870d-df5205812a4d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:08.921308 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.multi_cell_list [None req-cc855943-3d42-431f-870d-df5205812a4d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124230) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 00:31:09.019426 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-cc855943-3d42-431f-870d-df5205812a4d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.227343 Jun 16 00:31:09.020277 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 226/463] 10.222.0.23 () {58 vars in 1124 bytes} [Thu Jun 16 00:31:08 2022] GET /compute/v2.1/servers => generated 343 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:31:09.030626 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-234a562a-a4a4-4904-81e8-abba88674b74 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:09.031224 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-234a562a-a4a4-4904-81e8-abba88674b74 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:09.037440 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-234a562a-a4a4-4904-81e8-abba88674b74 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:09.037937 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-234a562a-a4a4-4904-81e8-abba88674b74 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:09.038624 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-234a562a-a4a4-4904-81e8-abba88674b74 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:09.039046 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-234a562a-a4a4-4904-81e8-abba88674b74 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:09.175506 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-234a562a-a4a4-4904-81e8-abba88674b74 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:09.183845 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-234a562a-a4a4-4904-81e8-abba88674b74 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1548 microversion: 2.1 time: 0.156804 Jun 16 00:31:09.184319 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 238/464] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:09 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:09.602724 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-f63c9c8f-9b5f-46c5-9d32-7dc8299f7edc tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:09.603335 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-f63c9c8f-9b5f-46c5-9d32-7dc8299f7edc tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:09.609773 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f63c9c8f-9b5f-46c5-9d32-7dc8299f7edc tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:09.610225 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f63c9c8f-9b5f-46c5-9d32-7dc8299f7edc tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:09.610983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f63c9c8f-9b5f-46c5-9d32-7dc8299f7edc tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:09.611417 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f63c9c8f-9b5f-46c5-9d32-7dc8299f7edc tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:09.746507 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f63c9c8f-9b5f-46c5-9d32-7dc8299f7edc tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:09.754497 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-f63c9c8f-9b5f-46c5-9d32-7dc8299f7edc tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1735 microversion: 2.1 time: 0.155643 Jun 16 00:31:09.755054 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 227/465] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:09 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:10.722976 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-34e910f0-e1a0-4bbc-a485-5fe159917219 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f209b2e-aa4b-4058-8017-5d20570333a5"}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:10.724128 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-34e910f0-e1a0-4bbc-a485-5fe159917219 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:10.731602 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-34e910f0-e1a0-4bbc-a485-5fe159917219 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:10.732077 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-34e910f0-e1a0-4bbc-a485-5fe159917219 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:10.732869 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-34e910f0-e1a0-4bbc-a485-5fe159917219 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:10.733367 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-34e910f0-e1a0-4bbc-a485-5fe159917219 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:10.773033 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c3294540-8cdd-46fd-ac96-96b163ef9943 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:10.773777 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c3294540-8cdd-46fd-ac96-96b163ef9943 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:10.779753 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c3294540-8cdd-46fd-ac96-96b163ef9943 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:10.780202 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c3294540-8cdd-46fd-ac96-96b163ef9943 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:10.780987 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c3294540-8cdd-46fd-ac96-96b163ef9943 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:10.781424 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c3294540-8cdd-46fd-ac96-96b163ef9943 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:10.931897 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c3294540-8cdd-46fd-ac96-96b163ef9943 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:10.940499 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c3294540-8cdd-46fd-ac96-96b163ef9943 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1735 microversion: 2.1 time: 0.173064 Jun 16 00:31:10.941121 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 228/466] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:10 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:11.026843 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-34e910f0-e1a0-4bbc-a485-5fe159917219 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "POST /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308120 Jun 16 00:31:11.027732 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 239/467] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Jun 16 00:31:10 2022] POST /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:31:11.957930 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d9ad611c-1310-42a3-bd41-fa116c630977 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:11.958534 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d9ad611c-1310-42a3-bd41-fa116c630977 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:11.965005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d9ad611c-1310-42a3-bd41-fa116c630977 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:11.965478 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d9ad611c-1310-42a3-bd41-fa116c630977 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:11.966228 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d9ad611c-1310-42a3-bd41-fa116c630977 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:11.966681 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d9ad611c-1310-42a3-bd41-fa116c630977 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:12.121067 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d9ad611c-1310-42a3-bd41-fa116c630977 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:12.129688 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d9ad611c-1310-42a3-bd41-fa116c630977 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1735 microversion: 2.1 time: 0.175920 Jun 16 00:31:12.130247 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 229/468] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:11 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:13.147995 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-16c2abc7-9d49-4050-963c-3feef1027c60 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:13.148706 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-16c2abc7-9d49-4050-963c-3feef1027c60 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:13.151107 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:13.158085 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-16c2abc7-9d49-4050-963c-3feef1027c60 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:13.158528 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-16c2abc7-9d49-4050-963c-3feef1027c60 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:13.159280 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-16c2abc7-9d49-4050-963c-3feef1027c60 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:13.159703 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-16c2abc7-9d49-4050-963c-3feef1027c60 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:13.293249 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-16c2abc7-9d49-4050-963c-3feef1027c60 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:13.301128 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-16c2abc7-9d49-4050-963c-3feef1027c60 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1735 microversion: 2.1 time: 0.157596 Jun 16 00:31:13.301688 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 240/469] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:13 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:14.318814 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c6043930-c759-4bed-ae4d-210bcbba49b0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:14.319428 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c6043930-c759-4bed-ae4d-210bcbba49b0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:14.325909 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c6043930-c759-4bed-ae4d-210bcbba49b0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:14.326362 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c6043930-c759-4bed-ae4d-210bcbba49b0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:14.327119 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c6043930-c759-4bed-ae4d-210bcbba49b0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:14.327557 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c6043930-c759-4bed-ae4d-210bcbba49b0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:14.454419 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c6043930-c759-4bed-ae4d-210bcbba49b0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:14.462329 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c6043930-c759-4bed-ae4d-210bcbba49b0 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1735 microversion: 2.1 time: 0.147390 Jun 16 00:31:14.462917 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 230/470] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:14 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:15.479523 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-c3f57ba0-d576-428b-a7db-7522f3d7c546 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:15.480122 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-c3f57ba0-d576-428b-a7db-7522f3d7c546 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:15.487277 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c3f57ba0-d576-428b-a7db-7522f3d7c546 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:15.487718 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c3f57ba0-d576-428b-a7db-7522f3d7c546 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:15.488471 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c3f57ba0-d576-428b-a7db-7522f3d7c546 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:15.488938 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c3f57ba0-d576-428b-a7db-7522f3d7c546 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:15.506463 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:15.619702 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-c3f57ba0-d576-428b-a7db-7522f3d7c546 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:15.628098 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-c3f57ba0-d576-428b-a7db-7522f3d7c546 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1735 microversion: 2.1 time: 0.152391 Jun 16 00:31:15.629082 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 241/471] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:15 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:16.646003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-32219cca-ab3b-4986-8db3-caa0c4790851 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:16.646611 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-32219cca-ab3b-4986-8db3-caa0c4790851 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:16.653117 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-32219cca-ab3b-4986-8db3-caa0c4790851 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:16.653565 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-32219cca-ab3b-4986-8db3-caa0c4790851 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:16.654315 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-32219cca-ab3b-4986-8db3-caa0c4790851 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:16.654742 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-32219cca-ab3b-4986-8db3-caa0c4790851 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:16.784315 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-32219cca-ab3b-4986-8db3-caa0c4790851 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:16.792179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-32219cca-ab3b-4986-8db3-caa0c4790851 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1735 microversion: 2.1 time: 0.150402 Jun 16 00:31:16.792746 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 231/472] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:16 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:17.809663 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-8debe587-1d3c-455c-8b5b-af18bea7e7d1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:17.810255 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-8debe587-1d3c-455c-8b5b-af18bea7e7d1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:17.817674 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8debe587-1d3c-455c-8b5b-af18bea7e7d1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:17.818114 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8debe587-1d3c-455c-8b5b-af18bea7e7d1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:17.818857 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8debe587-1d3c-455c-8b5b-af18bea7e7d1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:17.819286 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8debe587-1d3c-455c-8b5b-af18bea7e7d1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:17.947990 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-8debe587-1d3c-455c-8b5b-af18bea7e7d1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:17.956186 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-8debe587-1d3c-455c-8b5b-af18bea7e7d1 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1735 microversion: 2.1 time: 0.150344 Jun 16 00:31:17.956752 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 242/473] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:17 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:18.570321 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b0fdb04f-8643-4104-9d31-9aff826708cb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:18.570956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-b0fdb04f-8643-4104-9d31-9aff826708cb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:18.573399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=44 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:18.580244 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b0fdb04f-8643-4104-9d31-9aff826708cb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:18.580685 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b0fdb04f-8643-4104-9d31-9aff826708cb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:18.581476 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b0fdb04f-8643-4104-9d31-9aff826708cb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:18.581905 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b0fdb04f-8643-4104-9d31-9aff826708cb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:18.597228 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=100 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:18.714912 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b0fdb04f-8643-4104-9d31-9aff826708cb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:18.724159 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-b0fdb04f-8643-4104-9d31-9aff826708cb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1594 microversion: 2.1 time: 0.157604 Jun 16 00:31:18.724727 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 232/474] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:18 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1594 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:18.973251 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-4d8aaf08-fbc6-4154-92e3-fe4193a410ad tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:18.973882 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-4d8aaf08-fbc6-4154-92e3-fe4193a410ad tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:18.980301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4d8aaf08-fbc6-4154-92e3-fe4193a410ad tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:18.981127 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4d8aaf08-fbc6-4154-92e3-fe4193a410ad tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:18.981983 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4d8aaf08-fbc6-4154-92e3-fe4193a410ad tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:18.982414 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4d8aaf08-fbc6-4154-92e3-fe4193a410ad tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:19.195562 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-4d8aaf08-fbc6-4154-92e3-fe4193a410ad tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:19.204120 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-4d8aaf08-fbc6-4154-92e3-fe4193a410ad tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1735 microversion: 2.1 time: 0.234171 Jun 16 00:31:19.204742 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 243/475] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:18 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1735 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:20.221497 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-49b317e3-0d84-4c00-9cfa-72670a1a3658 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:20.222098 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-49b317e3-0d84-4c00-9cfa-72670a1a3658 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:20.223951 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=2 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:20.230162 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-49b317e3-0d84-4c00-9cfa-72670a1a3658 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:20.230700 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-49b317e3-0d84-4c00-9cfa-72670a1a3658 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:20.231545 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-49b317e3-0d84-4c00-9cfa-72670a1a3658 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:20.232048 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-49b317e3-0d84-4c00-9cfa-72670a1a3658 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:20.370311 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-49b317e3-0d84-4c00-9cfa-72670a1a3658 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:20.379363 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-49b317e3-0d84-4c00-9cfa-72670a1a3658 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1735 microversion: 2.1 time: 0.162283 Jun 16 00:31:20.379951 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 233/476] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:20 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:20.745055 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-70e2e332-8a31-4925-ab95-3b10774243d6 req-3adf6e73-98dd-4af6-82e2-ce06a83a24a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0750226-e65f-4cfc-94df-46f38bbd623c", "tag": "cff9c087-7e00-4554-b1a9-538c7504d332"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:20.754623 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-70e2e332-8a31-4925-ab95-3b10774243d6 req-3adf6e73-98dd-4af6-82e2-ce06a83a24a2 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:20.755153 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-70e2e332-8a31-4925-ab95-3b10774243d6 req-3adf6e73-98dd-4af6-82e2-ce06a83a24a2 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:20.768272 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-70e2e332-8a31-4925-ab95-3b10774243d6 req-3adf6e73-98dd-4af6-82e2-ce06a83a24a2 service nova] Creating event network-changed:cff9c087-7e00-4554-b1a9-538c7504d332 for instance c0750226-e65f-4cfc-94df-46f38bbd623c on hv-cinder-84599 Jun 16 00:31:20.773650 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-70e2e332-8a31-4925-ab95-3b10774243d6 req-3adf6e73-98dd-4af6-82e2-ce06a83a24a2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032619 Jun 16 00:31:20.774917 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 244/477] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:31:21.398342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-24536b23-5cb1-48cb-ab66-1d8be953d15b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:21.398957 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-24536b23-5cb1-48cb-ab66-1d8be953d15b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:21.405667 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-24536b23-5cb1-48cb-ab66-1d8be953d15b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:21.406518 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-24536b23-5cb1-48cb-ab66-1d8be953d15b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:21.407413 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-24536b23-5cb1-48cb-ab66-1d8be953d15b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:21.407849 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-24536b23-5cb1-48cb-ab66-1d8be953d15b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:21.571038 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-24536b23-5cb1-48cb-ab66-1d8be953d15b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:21.579664 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-24536b23-5cb1-48cb-ab66-1d8be953d15b tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1735 microversion: 2.1 time: 0.185362 Jun 16 00:31:21.580341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 234/478] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:21 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:21.803402 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-55407b46-63a8-40de-a873-a1b09400d306 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-604041049"}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:21.804615 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-55407b46-63a8-40de-a873-a1b09400d306 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:21.811229 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-55407b46-63a8-40de-a873-a1b09400d306 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:21.811699 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-55407b46-63a8-40de-a873-a1b09400d306 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:21.813098 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-55407b46-63a8-40de-a873-a1b09400d306 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:21.813584 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-55407b46-63a8-40de-a873-a1b09400d306 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:21.949886 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.network.security_group_api [None req-55407b46-63a8-40de-a873-a1b09400d306 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Adding security group 32dd3680-8cdd-46b9-b9cf-70343fb40770 to port cff9c087-7e00-4554-b1a9-538c7504d332 Jun 16 00:31:22.350704 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-55407b46-63a8-40de-a873-a1b09400d306 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "POST /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c/action" status: 202 len: 0 microversion: 2.1 time: 0.552118 Jun 16 00:31:22.351306 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 245/479] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Jun 16 00:31:21 2022] POST /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c/action => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:31:22.359358 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-69e1b19c-f381-4a17-91ac-9bce0223a718 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:22.360183 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-69e1b19c-f381-4a17-91ac-9bce0223a718 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:22.369270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-69e1b19c-f381-4a17-91ac-9bce0223a718 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:22.369712 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-69e1b19c-f381-4a17-91ac-9bce0223a718 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:22.370475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-69e1b19c-f381-4a17-91ac-9bce0223a718 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:22.370901 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-69e1b19c-f381-4a17-91ac-9bce0223a718 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:22.577212 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-69e1b19c-f381-4a17-91ac-9bce0223a718 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:22.587463 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-69e1b19c-f381-4a17-91ac-9bce0223a718 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1640 microversion: 2.1 time: 0.231835 Jun 16 00:31:22.588081 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 235/480] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:22 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1640 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:22.601756 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-0baa9e23-a686-4cde-9832-8d9459d6c415 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:22.602371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-0baa9e23-a686-4cde-9832-8d9459d6c415 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:22.608453 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0baa9e23-a686-4cde-9832-8d9459d6c415 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:22.608927 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0baa9e23-a686-4cde-9832-8d9459d6c415 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:22.609726 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0baa9e23-a686-4cde-9832-8d9459d6c415 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:22.610157 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0baa9e23-a686-4cde-9832-8d9459d6c415 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:22.747859 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-0baa9e23-a686-4cde-9832-8d9459d6c415 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:22.756423 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-0baa9e23-a686-4cde-9832-8d9459d6c415 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1735 microversion: 2.1 time: 0.158540 Jun 16 00:31:22.761034 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 246/481] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:22 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:22.789035 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-13c43316-3ac9-4cac-94fc-ea777bf6230d req-ea825683-55c1-4b11-a889-411b7abdf17a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0750226-e65f-4cfc-94df-46f38bbd623c", "tag": "cff9c087-7e00-4554-b1a9-538c7504d332"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:22.797401 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-13c43316-3ac9-4cac-94fc-ea777bf6230d req-ea825683-55c1-4b11-a889-411b7abdf17a service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:22.797939 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-13c43316-3ac9-4cac-94fc-ea777bf6230d req-ea825683-55c1-4b11-a889-411b7abdf17a service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:22.809323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-13c43316-3ac9-4cac-94fc-ea777bf6230d req-ea825683-55c1-4b11-a889-411b7abdf17a service nova] Creating event network-changed:cff9c087-7e00-4554-b1a9-538c7504d332 for instance c0750226-e65f-4cfc-94df-46f38bbd623c on hv-cinder-84599 Jun 16 00:31:22.815199 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-13c43316-3ac9-4cac-94fc-ea777bf6230d req-ea825683-55c1-4b11-a889-411b7abdf17a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029767 Jun 16 00:31:22.815794 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 236/482] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:31:23.774367 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-35bb626f-a0e5-4a74-80ed-0fe4cd311c65 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:23.774972 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-35bb626f-a0e5-4a74-80ed-0fe4cd311c65 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:23.782692 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-35bb626f-a0e5-4a74-80ed-0fe4cd311c65 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:23.783132 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-35bb626f-a0e5-4a74-80ed-0fe4cd311c65 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:23.783889 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-35bb626f-a0e5-4a74-80ed-0fe4cd311c65 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:23.784329 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-35bb626f-a0e5-4a74-80ed-0fe4cd311c65 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:23.916941 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-35bb626f-a0e5-4a74-80ed-0fe4cd311c65 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:23.925255 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-35bb626f-a0e5-4a74-80ed-0fe4cd311c65 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1735 microversion: 2.1 time: 0.154656 Jun 16 00:31:23.925989 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 247/483] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:23 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:24.944313 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-574ecca5-0bc8-4e31-b319-6e608f665e98 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:24.945316 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-574ecca5-0bc8-4e31-b319-6e608f665e98 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:24.951477 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-574ecca5-0bc8-4e31-b319-6e608f665e98 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:24.951917 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-574ecca5-0bc8-4e31-b319-6e608f665e98 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:24.952659 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-574ecca5-0bc8-4e31-b319-6e608f665e98 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:24.953239 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-574ecca5-0bc8-4e31-b319-6e608f665e98 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:25.081092 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-574ecca5-0bc8-4e31-b319-6e608f665e98 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:25.088859 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-574ecca5-0bc8-4e31-b319-6e608f665e98 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1715 microversion: 2.1 time: 0.149518 Jun 16 00:31:25.089438 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 237/484] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:24 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1715 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:25.190955 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-11b13e30-68e9-4fa5-af77-cffc9a114fb8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:25.191453 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-11b13e30-68e9-4fa5-af77-cffc9a114fb8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:25.197870 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-11b13e30-68e9-4fa5-af77-cffc9a114fb8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:25.198321 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-11b13e30-68e9-4fa5-af77-cffc9a114fb8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:25.199078 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-11b13e30-68e9-4fa5-af77-cffc9a114fb8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:25.199544 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-11b13e30-68e9-4fa5-af77-cffc9a114fb8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:25.323286 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-11b13e30-68e9-4fa5-af77-cffc9a114fb8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] HTTP exception thrown: Cannot 'detach_volume' instance 8298735b-2311-40d2-9261-ba64afe3b7fe while it is in vm_state rescued Jun 16 00:31:25.324909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-11b13e30-68e9-4fa5-af77-cffc9a114fb8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Request method failure captured: Jun 16 00:31:25.324909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: DELETE /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe/os-volume_attachments/ff5b4ce4-bc3f-41ae-9d82-2a0ab8b6e15d HTTP/1.1 Jun 16 00:31:25.324909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:31:25.324909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:31:25.324909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:31:25.324909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:31:25.324909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:31:25.324909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:31:25.324909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:31:25.324909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:31:25.324909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnjluY8jZVwwXlOxm5eGZoFzFsj2WHogoL70GrXk2XOxd5Vf-PQx2JzADNPun2hb_8YyL9atzw5OxHWiHsfPkN2e7HqJqwrKwxps6tY-O3e7u5qOSEIFwcLZmY6rGSskA_q37XGnDB6px_8ba9EsdtwksBNgGyqpqYD5fPwGkZ95O9E Jun 16 00:31:25.324909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:31:25.324909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:31:25.324909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:31:25.324909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:31:25.324909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:31:25.324909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:31:25.324909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: 0e5f17f8ba8e4113a27a004ebb29917a Jun 16 00:31:25.324909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1345783981 Jun 16 00:31:25.324909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:31:25.324909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:31:25.326450 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0e5f17f8ba8e4113a27a004ebb29917a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0e5f17f8ba8e4113a27a004ebb29917a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0e5f17f8ba8e4113a27a004ebb29917a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0e5f17f8ba8e4113a27a004ebb29917a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:31:25.326450 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1345783981 Jun 16 00:31:25.326450 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: 0e5f17f8ba8e4113a27a004ebb29917a Jun 16 00:31:25.326450 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1345783981 Jun 16 00:31:25.326450 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-ServerRescueNegativeTestJSON-1345783981-project Jun 16 00:31:25.326450 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:31:25.326450 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:31:25.326450 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: b5f4125ecaec41e5ba5c4eaf00c43e07 Jun 16 00:31:25.326450 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1345783981-project Jun 16 00:31:25.326450 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:31:25.326450 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Cannot 'detach_volume' instance 8298735b-2311-40d2-9261-ba64afe3b7fe while it is in vm_state rescued Jun 16 00:31:25.327308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'server_id': '8298735b-2311-40d2-9261-ba64afe3b7fe', 'id': 'ff5b4ce4-bc3f-41ae-9d82-2a0ab8b6e15d'} Jun 16 00:31:25.327308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:31:25.327308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:31:25.327308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 16 00:31:25.327308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 16 00:31:25.327308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 00:31:25.327308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 00:31:25.327308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 00:31:25.327308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 00:31:25.327308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8298735b-2311-40d2-9261-ba64afe3b7fe in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 16 00:31:25.327308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:31:25.327308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:31:25.327308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:31:25.327308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:31:25.327308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:31:25.327308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:31:25.327308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:31:25.327308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:31:25.327308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:31:25.327308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:31:25.329494 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 16 00:31:25.329494 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 00:31:25.329494 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 00:31:25.329494 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 00:31:25.329494 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8298735b-2311-40d2-9261-ba64afe3b7fe while it is in vm_state rescued Jun 16 00:31:25.329494 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:31:25.329494 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:31:25.329494 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:31:25.329494 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:31:25.329494 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:31:25.329494 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:31:25.329494 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:31:25.329494 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:31:25.329494 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8298735b-2311-40d2-9261-ba64afe3b7fe while it is in vm_state rescued Jun 16 00:31:25.329494 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:31:25.329494 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-11b13e30-68e9-4fa5-af77-cffc9a114fb8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Returning 409 to user: Cannot 'detach_volume' instance 8298735b-2311-40d2-9261-ba64afe3b7fe while it is in vm_state rescued {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:31:25.330777 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-11b13e30-68e9-4fa5-af77-cffc9a114fb8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe/os-volume_attachments/ff5b4ce4-bc3f-41ae-9d82-2a0ab8b6e15d" status: 409 len: 152 microversion: 2.1 time: 0.139689 Jun 16 00:31:25.330777 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 248/485] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Jun 16 00:31:25 2022] DELETE /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe/os-volume_attachments/ff5b4ce4-bc3f-41ae-9d82-2a0ab8b6e15d => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 00:31:25.335922 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5d088e48-388f-4002-aa94-a54f0e582bce tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:25.336453 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-5d088e48-388f-4002-aa94-a54f0e582bce tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:25.342453 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5d088e48-388f-4002-aa94-a54f0e582bce tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:25.342887 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5d088e48-388f-4002-aa94-a54f0e582bce tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:25.344291 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5d088e48-388f-4002-aa94-a54f0e582bce tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:25.344722 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5d088e48-388f-4002-aa94-a54f0e582bce tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:25.409498 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-5d088e48-388f-4002-aa94-a54f0e582bce tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "POST /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe/action" status: 202 len: 0 microversion: 2.1 time: 0.077147 Jun 16 00:31:25.410095 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 238/486] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Jun 16 00:31:25 2022] POST /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:31:25.418156 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-6c30df19-bcc2-4af4-840d-4ac0069ed5c9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:25.418871 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-6c30df19-bcc2-4af4-840d-4ac0069ed5c9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:25.426453 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6c30df19-bcc2-4af4-840d-4ac0069ed5c9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:25.427059 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6c30df19-bcc2-4af4-840d-4ac0069ed5c9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:25.427842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6c30df19-bcc2-4af4-840d-4ac0069ed5c9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:25.428461 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6c30df19-bcc2-4af4-840d-4ac0069ed5c9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:25.558845 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-6c30df19-bcc2-4af4-840d-4ac0069ed5c9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:25.567134 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-6c30df19-bcc2-4af4-840d-4ac0069ed5c9 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1723 microversion: 2.1 time: 0.152774 Jun 16 00:31:25.567773 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 249/487] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:25 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:26.584627 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-0313eae6-d616-4559-b4e5-27a4a1c18ac2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:26.585351 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-0313eae6-d616-4559-b4e5-27a4a1c18ac2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:26.591957 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0313eae6-d616-4559-b4e5-27a4a1c18ac2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:26.592396 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0313eae6-d616-4559-b4e5-27a4a1c18ac2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:26.593177 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0313eae6-d616-4559-b4e5-27a4a1c18ac2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:26.593603 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0313eae6-d616-4559-b4e5-27a4a1c18ac2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:26.725195 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0313eae6-d616-4559-b4e5-27a4a1c18ac2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:26.733089 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-0313eae6-d616-4559-b4e5-27a4a1c18ac2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1723 microversion: 2.1 time: 0.152736 Jun 16 00:31:26.733671 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 239/488] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:26 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:27.751300 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-5b96a17f-cac7-429d-8bdc-79e09c742fce tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:27.751908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-5b96a17f-cac7-429d-8bdc-79e09c742fce tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:27.758385 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5b96a17f-cac7-429d-8bdc-79e09c742fce tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:27.758831 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5b96a17f-cac7-429d-8bdc-79e09c742fce tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:27.759583 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5b96a17f-cac7-429d-8bdc-79e09c742fce tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:27.760021 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5b96a17f-cac7-429d-8bdc-79e09c742fce tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:27.894322 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-5b96a17f-cac7-429d-8bdc-79e09c742fce tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:27.902533 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-5b96a17f-cac7-429d-8bdc-79e09c742fce tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1723 microversion: 2.1 time: 0.155552 Jun 16 00:31:27.903098 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 250/489] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:27 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:28.921065 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-a81f573c-8aa2-4b98-b37e-3f282e5f6b05 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:28.923008 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-a81f573c-8aa2-4b98-b37e-3f282e5f6b05 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:28.927257 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-cc045e0f-2369-4e45-8d2d-32b0a9b77657 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:28.927789 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-cc045e0f-2369-4e45-8d2d-32b0a9b77657 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:28.930309 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a81f573c-8aa2-4b98-b37e-3f282e5f6b05 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:28.930859 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a81f573c-8aa2-4b98-b37e-3f282e5f6b05 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:28.931841 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a81f573c-8aa2-4b98-b37e-3f282e5f6b05 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:28.932399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a81f573c-8aa2-4b98-b37e-3f282e5f6b05 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:28.934756 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cc045e0f-2369-4e45-8d2d-32b0a9b77657 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:28.935138 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cc045e0f-2369-4e45-8d2d-32b0a9b77657 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:28.935901 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cc045e0f-2369-4e45-8d2d-32b0a9b77657 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:28.936331 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cc045e0f-2369-4e45-8d2d-32b0a9b77657 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:28.965374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-cc045e0f-2369-4e45-8d2d-32b0a9b77657 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7/os-volume_attachments/4eac7612-be72-46af-996f-32b39f8edcd9" status: 200 len: 194 microversion: 2.20 time: 0.043233 Jun 16 00:31:28.965964 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 251/490] 10.222.0.23 () {60 vars in 1453 bytes} [Thu Jun 16 00:31:28 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7/os-volume_attachments/4eac7612-be72-46af-996f-32b39f8edcd9 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:31:29.029937 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-fd024785-5481-4a9a-bc3d-02afdeb324e7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:29.030421 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-fd024785-5481-4a9a-bc3d-02afdeb324e7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:29.036992 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fd024785-5481-4a9a-bc3d-02afdeb324e7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:29.037434 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fd024785-5481-4a9a-bc3d-02afdeb324e7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:29.038189 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fd024785-5481-4a9a-bc3d-02afdeb324e7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:29.038617 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fd024785-5481-4a9a-bc3d-02afdeb324e7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:29.069157 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a81f573c-8aa2-4b98-b37e-3f282e5f6b05 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:29.076813 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-a81f573c-8aa2-4b98-b37e-3f282e5f6b05 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1729 microversion: 2.1 time: 0.160025 Jun 16 00:31:29.077410 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 240/491] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:28 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:29.093959 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-7b57cc00-097d-4f5c-87cb-e3a7044262ca tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:29.095106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-7b57cc00-097d-4f5c-87cb-e3a7044262ca tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:29.101852 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7b57cc00-097d-4f5c-87cb-e3a7044262ca tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:29.102305 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7b57cc00-097d-4f5c-87cb-e3a7044262ca tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:29.103075 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7b57cc00-097d-4f5c-87cb-e3a7044262ca tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:29.103510 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7b57cc00-097d-4f5c-87cb-e3a7044262ca tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:29.119556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.objects.instance [None req-fd024785-5481-4a9a-bc3d-02afdeb324e7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lazy-loading 'services' on Instance uuid 6b227643-24e7-44b6-acf7-d3801014a8c7 {{(pid=124231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:31:29.184315 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-7b57cc00-097d-4f5c-87cb-e3a7044262ca tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094321 Jun 16 00:31:29.185051 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 241/492] 10.222.0.23 () {58 vars in 1274 bytes} [Thu Jun 16 00:31:29 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:31:29.236722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-fd024785-5481-4a9a-bc3d-02afdeb324e7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7/os-volume_attachments/4eac7612-be72-46af-996f-32b39f8edcd9" status: 202 len: 0 microversion: 2.20 time: 0.210293 Jun 16 00:31:29.237354 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 252/493] 10.222.0.23 () {60 vars in 1456 bytes} [Thu Jun 16 00:31:29 2022] DELETE /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7/os-volume_attachments/4eac7612-be72-46af-996f-32b39f8edcd9 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 16 00:31:29.247511 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-635e4782-7b2c-4b1b-a1d6-9efaf7538675 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:29.248736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-635e4782-7b2c-4b1b-a1d6-9efaf7538675 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:29.256711 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-635e4782-7b2c-4b1b-a1d6-9efaf7538675 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:29.257366 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-635e4782-7b2c-4b1b-a1d6-9efaf7538675 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:29.258384 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-635e4782-7b2c-4b1b-a1d6-9efaf7538675 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:29.258938 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-635e4782-7b2c-4b1b-a1d6-9efaf7538675 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:29.293009 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-635e4782-7b2c-4b1b-a1d6-9efaf7538675 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050894 Jun 16 00:31:29.293562 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 242/494] 10.222.0.23 () {60 vars in 1342 bytes} [Thu Jun 16 00:31:29 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 00:31:30.098849 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-5de9568e-f8b3-4003-bff3-1d10bbb74413 req-9f133d85-5db5-4ce6-b845-a226e3bea729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8298735b-2311-40d2-9261-ba64afe3b7fe", "tag": "c5105353-b394-4e1d-81d1-b94b0637e747"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:30.109074 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-5de9568e-f8b3-4003-bff3-1d10bbb74413 req-9f133d85-5db5-4ce6-b845-a226e3bea729 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:30.110160 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-5de9568e-f8b3-4003-bff3-1d10bbb74413 req-9f133d85-5db5-4ce6-b845-a226e3bea729 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:30.126236 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-5de9568e-f8b3-4003-bff3-1d10bbb74413 req-9f133d85-5db5-4ce6-b845-a226e3bea729 service nova] Creating event network-changed:c5105353-b394-4e1d-81d1-b94b0637e747 for instance 8298735b-2311-40d2-9261-ba64afe3b7fe on hv-cinder-84599 Jun 16 00:31:30.131431 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-5de9568e-f8b3-4003-bff3-1d10bbb74413 req-9f133d85-5db5-4ce6-b845-a226e3bea729 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039517 Jun 16 00:31:30.132425 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 253/495] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:31:30.306048 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-05e6d13a-060d-4f60-8555-5cc8084d7868 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:30.307796 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-05e6d13a-060d-4f60-8555-5cc8084d7868 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:30.315590 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-05e6d13a-060d-4f60-8555-5cc8084d7868 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:30.316038 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-05e6d13a-060d-4f60-8555-5cc8084d7868 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:30.316806 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-05e6d13a-060d-4f60-8555-5cc8084d7868 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:30.317266 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-05e6d13a-060d-4f60-8555-5cc8084d7868 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:30.350216 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-05e6d13a-060d-4f60-8555-5cc8084d7868 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049806 Jun 16 00:31:30.351682 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 243/496] 10.222.0.23 () {60 vars in 1342 bytes} [Thu Jun 16 00:31:30 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:30.414656 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-ed091eaf-8423-487b-a745-7ef407220aaa tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:30.415479 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-ed091eaf-8423-487b-a745-7ef407220aaa tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:30.423041 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ed091eaf-8423-487b-a745-7ef407220aaa tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:30.423489 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ed091eaf-8423-487b-a745-7ef407220aaa tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:30.424258 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ed091eaf-8423-487b-a745-7ef407220aaa tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:30.424685 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ed091eaf-8423-487b-a745-7ef407220aaa tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:30.453255 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-ed091eaf-8423-487b-a745-7ef407220aaa tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Going to try to terminate instance {{(pid=124231) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:31:30.564790 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-ed091eaf-8423-487b-a745-7ef407220aaa tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 204 len: 0 microversion: 2.20 time: 0.154261 Jun 16 00:31:30.565590 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 254/497] 10.222.0.23 () {60 vars in 1279 bytes} [Thu Jun 16 00:31:30 2022] DELETE /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 00:31:30.573879 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-11772942-04ac-4fb2-bc9e-4956cbd13e14 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:30.574728 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-11772942-04ac-4fb2-bc9e-4956cbd13e14 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:30.582007 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-11772942-04ac-4fb2-bc9e-4956cbd13e14 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:30.582451 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-11772942-04ac-4fb2-bc9e-4956cbd13e14 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:30.583200 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-11772942-04ac-4fb2-bc9e-4956cbd13e14 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:30.583779 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-11772942-04ac-4fb2-bc9e-4956cbd13e14 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:30.721395 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-11772942-04ac-4fb2-bc9e-4956cbd13e14 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:30.729538 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-11772942-04ac-4fb2-bc9e-4956cbd13e14 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:30.731024 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-11772942-04ac-4fb2-bc9e-4956cbd13e14 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:30.732215 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-11772942-04ac-4fb2-bc9e-4956cbd13e14 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1724 microversion: 2.20 time: 0.162298 Jun 16 00:31:30.732763 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 244/498] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:30 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:31.751379 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-c168dccc-dbff-4158-bdbb-e88cb6b1f975 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:31.752004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-c168dccc-dbff-4158-bdbb-e88cb6b1f975 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:31.758469 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c168dccc-dbff-4158-bdbb-e88cb6b1f975 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:31.758908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c168dccc-dbff-4158-bdbb-e88cb6b1f975 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:31.759652 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c168dccc-dbff-4158-bdbb-e88cb6b1f975 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:31.760077 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c168dccc-dbff-4158-bdbb-e88cb6b1f975 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:31.892537 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-c168dccc-dbff-4158-bdbb-e88cb6b1f975 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:31.900695 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-c168dccc-dbff-4158-bdbb-e88cb6b1f975 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:31.902264 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-c168dccc-dbff-4158-bdbb-e88cb6b1f975 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:31.903403 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-c168dccc-dbff-4158-bdbb-e88cb6b1f975 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1724 microversion: 2.20 time: 0.156399 Jun 16 00:31:31.903956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 255/499] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:31 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:32.149338 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-8309fb5c-d539-421d-92dc-c22c048d60be req-6808f1d0-2d69-40da-92d5-e2b9f834e9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8298735b-2311-40d2-9261-ba64afe3b7fe", "tag": "c5105353-b394-4e1d-81d1-b94b0637e747"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:32.159191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-8309fb5c-d539-421d-92dc-c22c048d60be req-6808f1d0-2d69-40da-92d5-e2b9f834e9c9 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:32.159683 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-8309fb5c-d539-421d-92dc-c22c048d60be req-6808f1d0-2d69-40da-92d5-e2b9f834e9c9 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:32.171343 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-8309fb5c-d539-421d-92dc-c22c048d60be req-6808f1d0-2d69-40da-92d5-e2b9f834e9c9 service nova] Creating event network-changed:c5105353-b394-4e1d-81d1-b94b0637e747 for instance 8298735b-2311-40d2-9261-ba64afe3b7fe on hv-cinder-84599 Jun 16 00:31:32.178350 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-8309fb5c-d539-421d-92dc-c22c048d60be req-6808f1d0-2d69-40da-92d5-e2b9f834e9c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032495 Jun 16 00:31:32.178922 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 245/500] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:31:32.924011 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-97019fcd-67eb-4016-aae5-473c3a91be08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:32.924622 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-97019fcd-67eb-4016-aae5-473c3a91be08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:32.931134 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-97019fcd-67eb-4016-aae5-473c3a91be08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:32.931578 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-97019fcd-67eb-4016-aae5-473c3a91be08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:32.932328 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-97019fcd-67eb-4016-aae5-473c3a91be08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:32.933398 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-97019fcd-67eb-4016-aae5-473c3a91be08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:33.069329 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-97019fcd-67eb-4016-aae5-473c3a91be08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:33.077660 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-97019fcd-67eb-4016-aae5-473c3a91be08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:33.079321 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-97019fcd-67eb-4016-aae5-473c3a91be08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:33.080482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-97019fcd-67eb-4016-aae5-473c3a91be08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1724 microversion: 2.20 time: 0.160850 Jun 16 00:31:33.081064 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 256/501] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:32 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:33.588395 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-f6f8f439-9119-48b4-931b-e4f8b70b79c8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:33.589002 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-f6f8f439-9119-48b4-931b-e4f8b70b79c8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:33.596867 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f6f8f439-9119-48b4-931b-e4f8b70b79c8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:33.597445 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f6f8f439-9119-48b4-931b-e4f8b70b79c8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:33.598273 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f6f8f439-9119-48b4-931b-e4f8b70b79c8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:33.598784 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f6f8f439-9119-48b4-931b-e4f8b70b79c8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:33.623094 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-f6f8f439-9119-48b4-931b-e4f8b70b79c8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66/ips" status: 200 len: 149 microversion: 2.1 time: 0.039123 Jun 16 00:31:33.623659 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 246/502] 10.222.0.23 () {58 vars in 1247 bytes} [Thu Jun 16 00:31:33 2022] GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:31:33.634290 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-dd248698-25b3-42c8-90b0-97a87840e898 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5c3a275-77d5-41b1-b144-52edbdeb2c3b"}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:33.635345 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-dd248698-25b3-42c8-90b0-97a87840e898 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:33.641904 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-dd248698-25b3-42c8-90b0-97a87840e898 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:33.642389 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-dd248698-25b3-42c8-90b0-97a87840e898 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:33.643151 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-dd248698-25b3-42c8-90b0-97a87840e898 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:33.643582 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-dd248698-25b3-42c8-90b0-97a87840e898 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:33.661338 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:33.735583 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-dd248698-25b3-42c8-90b0-97a87840e898 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] HTTP exception thrown: Invalid volume: volume a5c3a275-77d5-41b1-b144-52edbdeb2c3b is already attached to instances: 401cad35-961b-4abf-a04c-796236ed5124 Jun 16 00:31:33.737682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-dd248698-25b3-42c8-90b0-97a87840e898 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Request method failure captured: Jun 16 00:31:33.737682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: POST /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66/os-volume_attachments HTTP/1.1 Jun 16 00:31:33.737682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:31:33.737682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:31:33.737682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:31:33.737682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 74 Jun 16 00:31:33.737682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:31:33.737682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:31:33.737682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:31:33.737682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:31:33.737682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnlEQtlTYlcSb6Cxq7ka8JkFDrXY9ZTyYkOKl7RMv-Nc50AOOLvvYPcyo-002Bp2d50a3LSSgJspVILfxuCarFtF9OBY195yuIkdM0DVC_olTUnFngMBTQdDXeOL4IjwWYA5CoVYPq-YWQwNW1R5R2mbX6MVy2x9qf1Ysp-JTmbE9Gk Jun 16 00:31:33.737682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:31:33.737682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:31:33.737682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:31:33.737682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:31:33.737682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:31:33.737682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:31:33.737682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:31:33.737682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:31:33.737682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:31:33.737682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:31:33.739088 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:31:33.739088 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:31:33.739088 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:31:33.739088 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:31:33.739088 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:31:33.739088 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:31:33.739088 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:31:33.739088 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: 535a03ce19d346d59e6a6f6befb9dea0 Jun 16 00:31:33.739088 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:31:33.739088 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Jun 16 00:31:33.739088 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {"volumeAttachment": {"volumeId": "a5c3a275-77d5-41b1-b144-52edbdeb2c3b"}} Jun 16 00:31:33.739088 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:31:33.739842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Invalid volume: volume a5c3a275-77d5-41b1-b144-52edbdeb2c3b is already attached to instances: 401cad35-961b-4abf-a04c-796236ed5124 Jun 16 00:31:33.739842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'server_id': '52832e7d-aae4-4a38-81ec-e84727dd8d66', 'body': {'volumeAttachment': {'volumeId': 'a5c3a275-77d5-41b1-b144-52edbdeb2c3b'}}} Jun 16 00:31:33.739842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:31:33.739842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:31:33.739842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 00:31:33.739842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 00:31:33.739842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 00:31:33.739842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 00:31:33.739842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 00:31:33.739842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 00:31:33.739842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 00:31:33.739842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 00:31:33.739842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 00:31:33.739842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 00:31:33.739842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a5c3a275-77d5-41b1-b144-52edbdeb2c3b is already attached to instances: 401cad35-961b-4abf-a04c-796236ed5124 Jun 16 00:31:33.739842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:31:33.739842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:31:33.739842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:31:33.739842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:31:33.741052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:31:33.741052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:31:33.741052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:31:33.741052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:31:33.741052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:31:33.741052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:31:33.741052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:31:33.741052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:31:33.741052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:31:33.741052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:31:33.741052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:31:33.741052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:31:33.741052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 00:31:33.741052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 00:31:33.741052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a5c3a275-77d5-41b1-b144-52edbdeb2c3b is already attached to instances: 401cad35-961b-4abf-a04c-796236ed5124 Jun 16 00:31:33.741052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:31:33.741052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:31:33.741052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:31:33.741052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:31:33.741052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:31:33.743024 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:31:33.743024 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:31:33.743024 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:31:33.743024 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a5c3a275-77d5-41b1-b144-52edbdeb2c3b is already attached to instances: 401cad35-961b-4abf-a04c-796236ed5124 Jun 16 00:31:33.743024 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:31:33.743024 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-dd248698-25b3-42c8-90b0-97a87840e898 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Returning 400 to user: Invalid volume: volume a5c3a275-77d5-41b1-b144-52edbdeb2c3b is already attached to instances: 401cad35-961b-4abf-a04c-796236ed5124 {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:31:33.743024 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-dd248698-25b3-42c8-90b0-97a87840e898 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "POST /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109094 Jun 16 00:31:33.743024 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 257/503] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Jun 16 00:31:33 2022] POST /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 00:31:33.748303 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-768c5474-2829-4d88-ba0c-5d67c7fbf87e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:33.748796 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-768c5474-2829-4d88-ba0c-5d67c7fbf87e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:33.754897 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-768c5474-2829-4d88-ba0c-5d67c7fbf87e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:33.755347 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-768c5474-2829-4d88-ba0c-5d67c7fbf87e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:33.756097 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-768c5474-2829-4d88-ba0c-5d67c7fbf87e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:33.756530 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-768c5474-2829-4d88-ba0c-5d67c7fbf87e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:33.799368 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-768c5474-2829-4d88-ba0c-5d67c7fbf87e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Going to try to terminate instance {{(pid=124230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:31:33.897354 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-768c5474-2829-4d88-ba0c-5d67c7fbf87e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "DELETE /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66" status: 204 len: 0 microversion: 2.1 time: 0.152396 Jun 16 00:31:33.898416 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 247/504] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:31:33 2022] DELETE /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:31:33.906118 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-04436c15-af38-49a0-8d00-ae098e2d3f44 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:33.907133 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-04436c15-af38-49a0-8d00-ae098e2d3f44 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:33.914153 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-04436c15-af38-49a0-8d00-ae098e2d3f44 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:33.914683 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-04436c15-af38-49a0-8d00-ae098e2d3f44 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:33.915510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-04436c15-af38-49a0-8d00-ae098e2d3f44 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:33.917584 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-04436c15-af38-49a0-8d00-ae098e2d3f44 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:34.064212 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-04436c15-af38-49a0-8d00-ae098e2d3f44 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:34.071973 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-04436c15-af38-49a0-8d00-ae098e2d3f44 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66" status: 200 len: 1682 microversion: 2.1 time: 0.169568 Jun 16 00:31:34.072541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 258/505] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:33 2022] GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:34.099275 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c0ef6064-a8df-43a9-ac26-7dfbadbbcd74 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:34.099960 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c0ef6064-a8df-43a9-ac26-7dfbadbbcd74 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:34.105969 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c0ef6064-a8df-43a9-ac26-7dfbadbbcd74 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:34.106411 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c0ef6064-a8df-43a9-ac26-7dfbadbbcd74 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:34.107171 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c0ef6064-a8df-43a9-ac26-7dfbadbbcd74 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:34.107593 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c0ef6064-a8df-43a9-ac26-7dfbadbbcd74 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:34.122622 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:34.147141 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c0ef6064-a8df-43a9-ac26-7dfbadbbcd74 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:34.147576 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c0ef6064-a8df-43a9-ac26-7dfbadbbcd74 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:34.148021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.objects.instance [None req-c0ef6064-a8df-43a9-ac26-7dfbadbbcd74 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lazy-loading 'fault' on Instance uuid 6b227643-24e7-44b6-acf7-d3801014a8c7 {{(pid=124230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:31:34.195342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c0ef6064-a8df-43a9-ac26-7dfbadbbcd74 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:34.196377 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-c7daeaee-3752-4b1e-84f5-56f3140a20d6 req-f567b107-b402-4faf-b73c-288c1e7d846d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b227643-24e7-44b6-acf7-d3801014a8c7", "name": "network-vif-deleted", "tag": "c88ef649-3637-4f5d-955c-f88ebc0bb6c5"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:34.204956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c0ef6064-a8df-43a9-ac26-7dfbadbbcd74 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:34.205622 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-c7daeaee-3752-4b1e-84f5-56f3140a20d6 req-f567b107-b402-4faf-b73c-288c1e7d846d service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:34.206406 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-c7daeaee-3752-4b1e-84f5-56f3140a20d6 req-f567b107-b402-4faf-b73c-288c1e7d846d service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:34.206548 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c0ef6064-a8df-43a9-ac26-7dfbadbbcd74 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:34.207673 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c0ef6064-a8df-43a9-ac26-7dfbadbbcd74 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1370 microversion: 2.20 time: 0.112637 Jun 16 00:31:34.208724 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 248/506] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:34 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1370 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:34.228773 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-c7daeaee-3752-4b1e-84f5-56f3140a20d6 req-f567b107-b402-4faf-b73c-288c1e7d846d service nova] Creating event network-vif-deleted:c88ef649-3637-4f5d-955c-f88ebc0bb6c5 for instance 6b227643-24e7-44b6-acf7-d3801014a8c7 on hv-cinder-84599 Jun 16 00:31:34.235146 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-c7daeaee-3752-4b1e-84f5-56f3140a20d6 req-f567b107-b402-4faf-b73c-288c1e7d846d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042541 Jun 16 00:31:34.236135 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 259/507] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:31:35.089878 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c2c2ea9d-cdf7-4c5b-a898-a0e594bcfe78 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:35.090482 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c2c2ea9d-cdf7-4c5b-a898-a0e594bcfe78 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:35.096988 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c2c2ea9d-cdf7-4c5b-a898-a0e594bcfe78 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:35.097442 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c2c2ea9d-cdf7-4c5b-a898-a0e594bcfe78 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:35.098196 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c2c2ea9d-cdf7-4c5b-a898-a0e594bcfe78 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:35.098624 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c2c2ea9d-cdf7-4c5b-a898-a0e594bcfe78 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:35.226134 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-1d9db17a-1965-4f64-8841-94a19118eae1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:35.226849 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-1d9db17a-1965-4f64-8841-94a19118eae1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:35.233823 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1d9db17a-1965-4f64-8841-94a19118eae1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:35.234852 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1d9db17a-1965-4f64-8841-94a19118eae1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:35.236215 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1d9db17a-1965-4f64-8841-94a19118eae1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:35.236654 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1d9db17a-1965-4f64-8841-94a19118eae1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:35.239853 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c2c2ea9d-cdf7-4c5b-a898-a0e594bcfe78 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:35.248155 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c2c2ea9d-cdf7-4c5b-a898-a0e594bcfe78 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66" status: 200 len: 1682 microversion: 2.1 time: 0.162100 Jun 16 00:31:35.248722 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 249/508] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:35 2022] GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:35.269077 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1d9db17a-1965-4f64-8841-94a19118eae1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:35.269773 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1d9db17a-1965-4f64-8841-94a19118eae1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:35.270222 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.objects.instance [None req-1d9db17a-1965-4f64-8841-94a19118eae1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lazy-loading 'fault' on Instance uuid 6b227643-24e7-44b6-acf7-d3801014a8c7 {{(pid=124231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:31:35.311204 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-1d9db17a-1965-4f64-8841-94a19118eae1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:35.320396 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-1d9db17a-1965-4f64-8841-94a19118eae1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:35.321922 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-1d9db17a-1965-4f64-8841-94a19118eae1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:35.323050 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-1d9db17a-1965-4f64-8841-94a19118eae1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 200 len: 1370 microversion: 2.20 time: 0.101164 Jun 16 00:31:35.323891 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 260/509] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:35 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 1370 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:36.267240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-ec9d16f9-5ebd-4180-9dcf-af8f44e519bc tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:36.267844 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-ec9d16f9-5ebd-4180-9dcf-af8f44e519bc tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:36.274733 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ec9d16f9-5ebd-4180-9dcf-af8f44e519bc tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:36.275175 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ec9d16f9-5ebd-4180-9dcf-af8f44e519bc tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:36.275923 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ec9d16f9-5ebd-4180-9dcf-af8f44e519bc tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:36.276347 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ec9d16f9-5ebd-4180-9dcf-af8f44e519bc tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:36.340919 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b9d6f703-fcd5-415b-9e7b-824f9f5787bd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:36.341362 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-b9d6f703-fcd5-415b-9e7b-824f9f5787bd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:36.343798 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-ec9d16f9-5ebd-4180-9dcf-af8f44e519bc tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:36.348848 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b9d6f703-fcd5-415b-9e7b-824f9f5787bd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:36.349315 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b9d6f703-fcd5-415b-9e7b-824f9f5787bd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:36.350084 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b9d6f703-fcd5-415b-9e7b-824f9f5787bd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:36.350514 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b9d6f703-fcd5-415b-9e7b-824f9f5787bd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:36.352172 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-ec9d16f9-5ebd-4180-9dcf-af8f44e519bc tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66" status: 200 len: 1614 microversion: 2.1 time: 0.089931 Jun 16 00:31:36.362181 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 250/510] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:36 2022] GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 => generated 1614 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:36.368207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-b9d6f703-fcd5-415b-9e7b-824f9f5787bd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] HTTP exception thrown: Instance 6b227643-24e7-44b6-acf7-d3801014a8c7 could not be found. Jun 16 00:31:36.370061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b9d6f703-fcd5-415b-9e7b-824f9f5787bd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Request method failure captured: Jun 16 00:31:36.370061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 HTTP/1.1 Jun 16 00:31:36.370061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:31:36.370061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:31:36.370061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:31:36.370061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:31:36.370061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:31:36.370061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:31:36.370061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:31:36.370061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:31:36.370061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnjkhYlnMQoJ6ll5DrxE3jVjof5ziwEcy_ENCJr9EqNSCv5ft04TUZZMBwQ1TNaX7gwedC-UXKiOJfwj-Zdfn04VMxb4f_qzjcrcCy16D8HNCbItqG2lNqbspZeOeulmf6LrG9KrmktpCZB5nBMoQF_kFqjoBnX9XETTs8rEZ7djSHI Jun 16 00:31:36.370061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:31:36.370061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:31:36.370061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:31:36.370061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:31:36.370061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 00:31:36.370061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:31:36.370061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:31:36.370061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: cd8526627add42a597eff6fce7400885 Jun 16 00:31:36.370061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-546813573 Jun 16 00:31:36.370061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:31:36.370061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:31:36.371956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cd8526627add42a597eff6fce7400885"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cd8526627add42a597eff6fce7400885"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd8526627add42a597eff6fce7400885"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd8526627add42a597eff6fce7400885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:31:36.371956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-AttachVolumeShelveTestJSON-546813573 Jun 16 00:31:36.371956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: cd8526627add42a597eff6fce7400885 Jun 16 00:31:36.371956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-546813573 Jun 16 00:31:36.371956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-AttachVolumeShelveTestJSON-546813573-project Jun 16 00:31:36.371956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:31:36.371956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:31:36.371956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: f1d7bb8f9d364c5198313fedd982478a Jun 16 00:31:36.371956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-AttachVolumeShelveTestJSON-546813573-project Jun 16 00:31:36.371956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:31:36.371956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Instance 6b227643-24e7-44b6-acf7-d3801014a8c7 could not be found. Jun 16 00:31:36.371956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': '6b227643-24e7-44b6-acf7-d3801014a8c7'} Jun 16 00:31:36.372934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:31:36.372934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:31:36.372934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:31:36.372934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:31:36.372934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:31:36.372934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:31:36.372934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:31:36.372934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:31:36.372934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:31:36.372934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:31:36.372934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b227643-24e7-44b6-acf7-d3801014a8c7 could not be found. Jun 16 00:31:36.372934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:31:36.372934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:31:36.372934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:31:36.372934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:31:36.372934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:31:36.372934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:31:36.372934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:31:36.372934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:31:36.372934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:31:36.374304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:31:36.374304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:31:36.374304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:31:36.374304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:31:36.374304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:31:36.374304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:31:36.374304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:31:36.374304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b227643-24e7-44b6-acf7-d3801014a8c7 could not be found. Jun 16 00:31:36.374304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:31:36.374304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:31:36.374304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:31:36.374304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:31:36.374304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:31:36.374304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:31:36.374304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:31:36.374304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:31:36.374304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b227643-24e7-44b6-acf7-d3801014a8c7 could not be found. Jun 16 00:31:36.374304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:31:36.377587 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b9d6f703-fcd5-415b-9e7b-824f9f5787bd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Returning 404 to user: Instance 6b227643-24e7-44b6-acf7-d3801014a8c7 could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:31:36.378750 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-b9d6f703-fcd5-415b-9e7b-824f9f5787bd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 404 len: 111 microversion: 2.20 time: 0.042197 Jun 16 00:31:36.379297 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 261/511] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:36 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 16 00:31:36.387871 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-6bc8a298-e23d-435e-bd79-e067aa42c652 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '.version_select at 0x7fe704af2ee0>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:36.407775 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-6bc8a298-e23d-435e-bd79-e067aa42c652 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-802527258" status: 204 len: 0 microversion: 2.20 time: 0.023666 Jun 16 00:31:36.408585 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 251/512] 10.222.0.23 () {60 vars in 1258 bytes} [Thu Jun 16 00:31:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-802527258 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 00:31:36.543958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-b1810507-dfff-4168-920b-5f61d54f3fbe req-81926584-a490-46db-9ca4-91c56b9c5772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52832e7d-aae4-4a38-81ec-e84727dd8d66", "name": "network-vif-deleted", "tag": "5485f1e1-4a63-42e1-96bc-20193c388b65"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:36.580869 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-b1810507-dfff-4168-920b-5f61d54f3fbe req-81926584-a490-46db-9ca4-91c56b9c5772 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:36.585231 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-b1810507-dfff-4168-920b-5f61d54f3fbe req-81926584-a490-46db-9ca4-91c56b9c5772 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:36.601552 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-b1810507-dfff-4168-920b-5f61d54f3fbe req-81926584-a490-46db-9ca4-91c56b9c5772 service nova] Creating event network-vif-deleted:5485f1e1-4a63-42e1-96bc-20193c388b65 for instance 52832e7d-aae4-4a38-81ec-e84727dd8d66 on hv-cinder-84599 Jun 16 00:31:36.610222 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-b1810507-dfff-4168-920b-5f61d54f3fbe req-81926584-a490-46db-9ca4-91c56b9c5772 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070733 Jun 16 00:31:36.610852 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 262/513] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:31:37.229133 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-da584e68-24d2-4245-b7fd-4d9de0b9e17f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Action: 'create', calling method: .version_select at 0x7fe704af50d0>, body: {"keypair": {"name": "tempest-keypair-699043444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFu5f0duajecbijG+UdImrYr9PuSVel86KkptYd5T3vsv9uhE7X/BaGfBeIn6EsIe7mlTlasJYhAaZzsqaTr9WE9c1S+d/sdsilW1sqwTXbntlAYK/WgL1QvdgCBx3u/jA=="}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:37.243518 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-da584e68-24d2-4245-b7fd-4d9de0b9e17f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Getting quotas for project cd8526627add42a597eff6fce7400885. Resources: {'key_pairs'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:31:37.247347 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-da584e68-24d2-4245-b7fd-4d9de0b9e17f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Getting quotas for user f1d7bb8f9d364c5198313fedd982478a and project cd8526627add42a597eff6fce7400885. Resources: {'key_pairs'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:31:37.270635 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-da584e68-24d2-4245-b7fd-4d9de0b9e17f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045632 Jun 16 00:31:37.272989 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 252/514] 10.222.0.23 () {62 vars in 1199 bytes} [Thu Jun 16 00:31:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 00:31:37.370019 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-9d0e97e3-77c3-4555-b0eb-3d1da91131fd tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:37.370662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-9d0e97e3-77c3-4555-b0eb-3d1da91131fd tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:37.377758 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9d0e97e3-77c3-4555-b0eb-3d1da91131fd tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:37.378337 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9d0e97e3-77c3-4555-b0eb-3d1da91131fd tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:37.378937 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9d0e97e3-77c3-4555-b0eb-3d1da91131fd tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:37.379360 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9d0e97e3-77c3-4555-b0eb-3d1da91131fd tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:37.393862 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-9d0e97e3-77c3-4555-b0eb-3d1da91131fd tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] HTTP exception thrown: Instance 52832e7d-aae4-4a38-81ec-e84727dd8d66 could not be found. Jun 16 00:31:37.395775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-9d0e97e3-77c3-4555-b0eb-3d1da91131fd tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Request method failure captured: Jun 16 00:31:37.395775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 HTTP/1.1 Jun 16 00:31:37.395775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:31:37.395775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:31:37.395775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:31:37.395775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:31:37.395775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:31:37.395775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:31:37.395775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:31:37.395775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:31:37.395775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnlEQtlTYlcSb6Cxq7ka8JkFDrXY9ZTyYkOKl7RMv-Nc50AOOLvvYPcyo-002Bp2d50a3LSSgJspVILfxuCarFtF9OBY195yuIkdM0DVC_olTUnFngMBTQdDXeOL4IjwWYA5CoVYPq-YWQwNW1R5R2mbX6MVy2x9qf1Ysp-JTmbE9Gk Jun 16 00:31:37.395775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:31:37.395775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:31:37.395775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:31:37.395775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:31:37.395775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:31:37.395775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:31:37.395775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:31:37.395775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:31:37.395775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:31:37.395775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:31:37.397118 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:31:37.397118 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:31:37.397118 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:31:37.397118 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:31:37.397118 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:31:37.397118 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:31:37.397118 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:31:37.397118 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: 535a03ce19d346d59e6a6f6befb9dea0 Jun 16 00:31:37.397118 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:31:37.397118 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:31:37.397118 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Instance 52832e7d-aae4-4a38-81ec-e84727dd8d66 could not be found. Jun 16 00:31:37.397118 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': '52832e7d-aae4-4a38-81ec-e84727dd8d66'} Jun 16 00:31:37.397863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:31:37.397863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:31:37.397863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:31:37.397863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:31:37.397863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:31:37.397863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:31:37.397863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:31:37.397863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:31:37.397863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:31:37.397863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:31:37.397863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52832e7d-aae4-4a38-81ec-e84727dd8d66 could not be found. Jun 16 00:31:37.397863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:31:37.397863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:31:37.397863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:31:37.397863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:31:37.397863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:31:37.397863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:31:37.397863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:31:37.397863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:31:37.397863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:31:37.399644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:31:37.399644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:31:37.399644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:31:37.399644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:31:37.399644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:31:37.399644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:31:37.399644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:31:37.399644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52832e7d-aae4-4a38-81ec-e84727dd8d66 could not be found. Jun 16 00:31:37.399644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:31:37.399644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:31:37.399644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:31:37.399644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:31:37.399644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:31:37.399644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:31:37.399644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:31:37.399644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:31:37.399644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52832e7d-aae4-4a38-81ec-e84727dd8d66 could not be found. Jun 16 00:31:37.399644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:31:37.401119 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-9d0e97e3-77c3-4555-b0eb-3d1da91131fd tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Returning 404 to user: Instance 52832e7d-aae4-4a38-81ec-e84727dd8d66 could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:31:37.401119 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-9d0e97e3-77c3-4555-b0eb-3d1da91131fd tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66" status: 404 len: 111 microversion: 2.1 time: 0.031471 Jun 16 00:31:37.405854 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-ddf24b7e-d8f4-42ad-b6a7-60a7498ffac6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '.version_select at 0x7fe704a92c10>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:37.413036 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 263/515] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:37 2022] GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:31:37.430531 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-ddf24b7e-d8f4-42ad-b6a7-60a7498ffac6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1751190747" status: 202 len: 0 microversion: 2.1 time: 0.028313 Jun 16 00:31:37.431122 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 253/516] 10.222.0.23 () {58 vars in 1220 bytes} [Thu Jun 16 00:31:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1751190747 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:31:38.193843 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-f7b15f8c-541e-4385-841d-220a080d99da tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:38.194326 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-f7b15f8c-541e-4385-841d-220a080d99da tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:38.200446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f7b15f8c-541e-4385-841d-220a080d99da tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:38.200912 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f7b15f8c-541e-4385-841d-220a080d99da tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:38.201659 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f7b15f8c-541e-4385-841d-220a080d99da tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:38.202082 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f7b15f8c-541e-4385-841d-220a080d99da tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:38.287910 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.objects.instance [None req-f7b15f8c-541e-4385-841d-220a080d99da tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lazy-loading 'services' on Instance uuid 401cad35-961b-4abf-a04c-796236ed5124 {{(pid=124231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:31:38.363291 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-f7b15f8c-541e-4385-841d-220a080d99da tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "DELETE /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124/os-volume_attachments/a5c3a275-77d5-41b1-b144-52edbdeb2c3b" status: 202 len: 0 microversion: 2.1 time: 0.173058 Jun 16 00:31:38.363901 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 264/517] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Jun 16 00:31:38 2022] DELETE /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124/os-volume_attachments/a5c3a275-77d5-41b1-b144-52edbdeb2c3b => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:31:38.373482 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-1078350d-39aa-4a0f-80e3-4303f4988661 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:38.375941 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-1078350d-39aa-4a0f-80e3-4303f4988661 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:38.383435 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1078350d-39aa-4a0f-80e3-4303f4988661 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:38.384272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1078350d-39aa-4a0f-80e3-4303f4988661 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:38.386147 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1078350d-39aa-4a0f-80e3-4303f4988661 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:38.386952 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1078350d-39aa-4a0f-80e3-4303f4988661 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:38.420533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-1078350d-39aa-4a0f-80e3-4303f4988661 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052225 Jun 16 00:31:38.421269 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 254/518] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Jun 16 00:31:38 2022] GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:31:38.651819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-8d796485-64e2-4b76-ace8-06df1e2a8a08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1583405838", "imageRef": "d9a6de24-7a5e-4f8b-b078-809c87b15d56", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc84a00d-15c4-4773-9b21-ea4524d0b0d5"}], "security_groups": [{"name": "tempest-securitygroup--1123048749"}], "key_name": "tempest-keypair-699043444", "user_data": "}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:38.752025 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.network.neutron [None req-8d796485-64e2-4b76-ace8-06df1e2a8a08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] validate_networks() for [('dc84a00d-15c4-4773-9b21-ea4524d0b0d5', None, None, None, None, None)] {{(pid=124231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:31:39.124711 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-8d796485-64e2-4b76-ace8-06df1e2a8a08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Flavor limits 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:31:39.125866 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-8d796485-64e2-4b76-ace8-06df1e2a8a08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Image limits 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:31:39.126335 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-8d796485-64e2-4b76-ace8-06df1e2a8a08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Flavor pref 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:31:39.126734 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-8d796485-64e2-4b76-ace8-06df1e2a8a08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Image pref 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:31:39.127156 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-8d796485-64e2-4b76-ace8-06df1e2a8a08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:31:39.137420 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8d796485-64e2-4b76-ace8-06df1e2a8a08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:39.137866 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8d796485-64e2-4b76-ace8-06df1e2a8a08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:39.138699 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8d796485-64e2-4b76-ace8-06df1e2a8a08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:39.139133 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8d796485-64e2-4b76-ace8-06df1e2a8a08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:39.163771 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-8d796485-64e2-4b76-ace8-06df1e2a8a08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Getting quotas for project cd8526627add42a597eff6fce7400885. Resources: {'ram', 'cores', 'instances'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:31:39.168422 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-8d796485-64e2-4b76-ace8-06df1e2a8a08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Getting quotas for user f1d7bb8f9d364c5198313fedd982478a and project cd8526627add42a597eff6fce7400885. Resources: {'ram', 'cores', 'instances'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:31:39.182795 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-8d796485-64e2-4b76-ace8-06df1e2a8a08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Going to run 1 instances... {{(pid=124231) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:31:39.186177 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-8d796485-64e2-4b76-ace8-06df1e2a8a08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d9a6de24-7a5e-4f8b-b078-809c87b15d56',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:31:39.246525 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-8d796485-64e2-4b76-ace8-06df1e2a8a08 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.599746 Jun 16 00:31:39.247192 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 265/519] 10.222.0.23 () {62 vars in 1187 bytes} [Thu Jun 16 00:31:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 00:31:39.257945 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-a0f65379-9608-41e6-8290-d8b222b77851 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:39.259014 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-a0f65379-9608-41e6-8290-d8b222b77851 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:39.323142 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a0f65379-9608-41e6-8290-d8b222b77851 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:39.331416 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a0f65379-9608-41e6-8290-d8b222b77851 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:39.332935 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a0f65379-9608-41e6-8290-d8b222b77851 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:39.334135 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-a0f65379-9608-41e6-8290-d8b222b77851 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1281 microversion: 2.20 time: 0.080435 Jun 16 00:31:39.334684 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 255/520] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:39 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1281 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:39.434009 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-e2f5439c-af48-40ab-8b69-f31338480e5b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:39.434914 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-e2f5439c-af48-40ab-8b69-f31338480e5b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:39.443424 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e2f5439c-af48-40ab-8b69-f31338480e5b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:39.443864 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e2f5439c-af48-40ab-8b69-f31338480e5b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:39.444628 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e2f5439c-af48-40ab-8b69-f31338480e5b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:39.445112 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e2f5439c-af48-40ab-8b69-f31338480e5b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:39.479210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-e2f5439c-af48-40ab-8b69-f31338480e5b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049638 Jun 16 00:31:39.479828 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 266/521] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Jun 16 00:31:39 2022] GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:31:39.543509 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-6f974bfb-25cf-46d9-b9fe-2cdad4c96c3b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:39.544188 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-6f974bfb-25cf-46d9-b9fe-2cdad4c96c3b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:39.554483 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6f974bfb-25cf-46d9-b9fe-2cdad4c96c3b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:39.555168 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6f974bfb-25cf-46d9-b9fe-2cdad4c96c3b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:39.556603 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6f974bfb-25cf-46d9-b9fe-2cdad4c96c3b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:39.557149 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6f974bfb-25cf-46d9-b9fe-2cdad4c96c3b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:39.586336 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-6f974bfb-25cf-46d9-b9fe-2cdad4c96c3b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Going to try to terminate instance {{(pid=124230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:31:39.672607 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-6f974bfb-25cf-46d9-b9fe-2cdad4c96c3b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "DELETE /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124" status: 204 len: 0 microversion: 2.1 time: 0.132700 Jun 16 00:31:39.676221 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 256/522] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:31:39 2022] DELETE /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:31:39.682243 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-af926d02-a21b-4d69-9205-590a01ecce3f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:39.683004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-af926d02-a21b-4d69-9205-590a01ecce3f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:39.690829 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-af926d02-a21b-4d69-9205-590a01ecce3f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:39.692744 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-af926d02-a21b-4d69-9205-590a01ecce3f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:39.692744 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-af926d02-a21b-4d69-9205-590a01ecce3f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:39.692744 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-af926d02-a21b-4d69-9205-590a01ecce3f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:39.858043 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-af926d02-a21b-4d69-9205-590a01ecce3f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:39.866369 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-af926d02-a21b-4d69-9205-590a01ecce3f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124" status: 200 len: 1677 microversion: 2.1 time: 0.188511 Jun 16 00:31:39.867001 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 267/523] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:39 2022] GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124 => generated 1677 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:40.353785 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-af0036cc-3bad-4b77-b8f6-3d7c7680d8bc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:40.354466 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-af0036cc-3bad-4b77-b8f6-3d7c7680d8bc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:40.361152 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-af0036cc-3bad-4b77-b8f6-3d7c7680d8bc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:40.361590 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-af0036cc-3bad-4b77-b8f6-3d7c7680d8bc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:40.362336 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-af0036cc-3bad-4b77-b8f6-3d7c7680d8bc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:40.362759 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-af0036cc-3bad-4b77-b8f6-3d7c7680d8bc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:40.425336 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-af0036cc-3bad-4b77-b8f6-3d7c7680d8bc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:40.433979 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-af0036cc-3bad-4b77-b8f6-3d7c7680d8bc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:40.435565 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-af0036cc-3bad-4b77-b8f6-3d7c7680d8bc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:40.436641 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-af0036cc-3bad-4b77-b8f6-3d7c7680d8bc tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1285 microversion: 2.20 time: 0.087117 Jun 16 00:31:40.438066 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 257/524] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:40 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:40.883478 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b3366417-91b9-44ee-b10e-90de240f00c1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:40.884089 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-b3366417-91b9-44ee-b10e-90de240f00c1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:40.890855 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b3366417-91b9-44ee-b10e-90de240f00c1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:40.891303 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b3366417-91b9-44ee-b10e-90de240f00c1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:40.892058 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b3366417-91b9-44ee-b10e-90de240f00c1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:40.892491 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b3366417-91b9-44ee-b10e-90de240f00c1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:41.017882 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-b3366417-91b9-44ee-b10e-90de240f00c1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:41.025518 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-b3366417-91b9-44ee-b10e-90de240f00c1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124" status: 200 len: 1677 microversion: 2.1 time: 0.145865 Jun 16 00:31:41.026070 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 268/525] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:40 2022] GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:41.455918 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b84b8d9e-2f2a-4849-af59-8e04dfda37a7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:41.456525 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-b84b8d9e-2f2a-4849-af59-8e04dfda37a7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:41.463099 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b84b8d9e-2f2a-4849-af59-8e04dfda37a7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:41.463546 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b84b8d9e-2f2a-4849-af59-8e04dfda37a7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:41.464308 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b84b8d9e-2f2a-4849-af59-8e04dfda37a7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:41.464744 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b84b8d9e-2f2a-4849-af59-8e04dfda37a7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:41.526238 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b84b8d9e-2f2a-4849-af59-8e04dfda37a7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:41.534070 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b84b8d9e-2f2a-4849-af59-8e04dfda37a7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:41.535548 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b84b8d9e-2f2a-4849-af59-8e04dfda37a7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:41.536611 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-b84b8d9e-2f2a-4849-af59-8e04dfda37a7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1333 microversion: 2.20 time: 0.085237 Jun 16 00:31:41.537193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 258/526] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:41 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1333 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:42.043541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-1761b848-8e8c-4fdf-bea7-96998543992a tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:42.044063 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-1761b848-8e8c-4fdf-bea7-96998543992a tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:42.051069 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1761b848-8e8c-4fdf-bea7-96998543992a tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:42.051517 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1761b848-8e8c-4fdf-bea7-96998543992a tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:42.052281 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1761b848-8e8c-4fdf-bea7-96998543992a tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:42.052714 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1761b848-8e8c-4fdf-bea7-96998543992a tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:42.188331 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-1761b848-8e8c-4fdf-bea7-96998543992a tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:42.196068 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-1761b848-8e8c-4fdf-bea7-96998543992a tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124" status: 200 len: 1677 microversion: 2.1 time: 0.156503 Jun 16 00:31:42.197034 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 269/527] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:42 2022] GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:42.553903 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d28022d3-ccfa-4d6b-9c60-4be1bb9067c7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:42.554626 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d28022d3-ccfa-4d6b-9c60-4be1bb9067c7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:42.561311 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d28022d3-ccfa-4d6b-9c60-4be1bb9067c7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:42.561828 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d28022d3-ccfa-4d6b-9c60-4be1bb9067c7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:42.563341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d28022d3-ccfa-4d6b-9c60-4be1bb9067c7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:42.563855 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d28022d3-ccfa-4d6b-9c60-4be1bb9067c7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:42.650292 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d28022d3-ccfa-4d6b-9c60-4be1bb9067c7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:42.659292 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d28022d3-ccfa-4d6b-9c60-4be1bb9067c7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:42.660781 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d28022d3-ccfa-4d6b-9c60-4be1bb9067c7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:42.661895 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d28022d3-ccfa-4d6b-9c60-4be1bb9067c7 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1339 microversion: 2.20 time: 0.111919 Jun 16 00:31:42.662659 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 259/528] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:42 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1339 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:43.186420 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-58fb734d-3e78-4ce6-9cc0-38bf407e4692 req-4a2f022f-a6d3-47c1-bdab-e28e194cb4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401cad35-961b-4abf-a04c-796236ed5124", "name": "network-vif-deleted", "tag": "a5a85d6b-1c98-44e7-b9ae-055f24d881a9"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:43.201186 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:43.215385 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-6c3d9178-9623-44ee-8889-0bf1c87631c9 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:43.216305 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-6c3d9178-9623-44ee-8889-0bf1c87631c9 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:43.230490 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-58fb734d-3e78-4ce6-9cc0-38bf407e4692 req-4a2f022f-a6d3-47c1-bdab-e28e194cb4f3 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:43.231916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6c3d9178-9623-44ee-8889-0bf1c87631c9 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:43.232486 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-58fb734d-3e78-4ce6-9cc0-38bf407e4692 req-4a2f022f-a6d3-47c1-bdab-e28e194cb4f3 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:43.233367 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6c3d9178-9623-44ee-8889-0bf1c87631c9 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:43.249105 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6c3d9178-9623-44ee-8889-0bf1c87631c9 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:43.250105 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6c3d9178-9623-44ee-8889-0bf1c87631c9 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:43.282475 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-58fb734d-3e78-4ce6-9cc0-38bf407e4692 req-4a2f022f-a6d3-47c1-bdab-e28e194cb4f3 service nova] Creating event network-vif-deleted:a5a85d6b-1c98-44e7-b9ae-055f24d881a9 for instance 401cad35-961b-4abf-a04c-796236ed5124 on hv-cinder-84599 Jun 16 00:31:43.293631 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-58fb734d-3e78-4ce6-9cc0-38bf407e4692 req-4a2f022f-a6d3-47c1-bdab-e28e194cb4f3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115737 Jun 16 00:31:43.294546 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 270/529] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:31:43.361957 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-6c3d9178-9623-44ee-8889-0bf1c87631c9 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:43.373799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-6c3d9178-9623-44ee-8889-0bf1c87631c9 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124" status: 200 len: 1326 microversion: 2.1 time: 0.163486 Jun 16 00:31:43.374802 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 260/530] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:43 2022] GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124 => generated 1326 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:31:43.690544 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-fc15ddbc-e684-4552-9dda-239a431a8a55 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:43.692953 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-fc15ddbc-e684-4552-9dda-239a431a8a55 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:43.700192 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fc15ddbc-e684-4552-9dda-239a431a8a55 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:43.700906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fc15ddbc-e684-4552-9dda-239a431a8a55 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:43.701992 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fc15ddbc-e684-4552-9dda-239a431a8a55 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:43.703253 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fc15ddbc-e684-4552-9dda-239a431a8a55 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:43.881148 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-fc15ddbc-e684-4552-9dda-239a431a8a55 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:43.889624 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-fc15ddbc-e684-4552-9dda-239a431a8a55 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:43.891454 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-fc15ddbc-e684-4552-9dda-239a431a8a55 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:43.892805 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-fc15ddbc-e684-4552-9dda-239a431a8a55 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1407 microversion: 2.20 time: 0.216089 Jun 16 00:31:43.893432 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 271/531] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:43 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:44.392103 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-ec35e22e-0cd5-4c7d-b44d-c3e2bd9cf6c8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:44.392808 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-ec35e22e-0cd5-4c7d-b44d-c3e2bd9cf6c8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:44.400830 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ec35e22e-0cd5-4c7d-b44d-c3e2bd9cf6c8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:44.401584 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ec35e22e-0cd5-4c7d-b44d-c3e2bd9cf6c8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:44.402684 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ec35e22e-0cd5-4c7d-b44d-c3e2bd9cf6c8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:44.403267 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ec35e22e-0cd5-4c7d-b44d-c3e2bd9cf6c8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:44.420396 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-ec35e22e-0cd5-4c7d-b44d-c3e2bd9cf6c8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] HTTP exception thrown: Instance 401cad35-961b-4abf-a04c-796236ed5124 could not be found. Jun 16 00:31:44.422885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-ec35e22e-0cd5-4c7d-b44d-c3e2bd9cf6c8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Request method failure captured: Jun 16 00:31:44.422885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124 HTTP/1.1 Jun 16 00:31:44.422885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:31:44.422885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:31:44.422885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:31:44.422885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:31:44.422885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:31:44.422885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:31:44.422885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:31:44.422885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:31:44.422885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnlEQtlTYlcSb6Cxq7ka8JkFDrXY9ZTyYkOKl7RMv-Nc50AOOLvvYPcyo-002Bp2d50a3LSSgJspVILfxuCarFtF9OBY195yuIkdM0DVC_olTUnFngMBTQdDXeOL4IjwWYA5CoVYPq-YWQwNW1R5R2mbX6MVy2x9qf1Ysp-JTmbE9Gk Jun 16 00:31:44.422885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:31:44.422885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:31:44.422885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:31:44.422885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:31:44.422885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:31:44.422885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:31:44.422885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:31:44.422885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:31:44.422885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:31:44.422885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:31:44.424429 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:31:44.424429 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:31:44.424429 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:31:44.424429 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:31:44.424429 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:31:44.424429 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:31:44.424429 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:31:44.424429 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: 535a03ce19d346d59e6a6f6befb9dea0 Jun 16 00:31:44.424429 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:31:44.424429 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: > Jun 16 00:31:44.424429 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Instance 401cad35-961b-4abf-a04c-796236ed5124 could not be found. Jun 16 00:31:44.424429 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'id': '401cad35-961b-4abf-a04c-796236ed5124'} Jun 16 00:31:44.425272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:31:44.425272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:31:44.425272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:31:44.425272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:31:44.425272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:31:44.425272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:31:44.425272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:31:44.425272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:31:44.425272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:31:44.425272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:31:44.425272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 401cad35-961b-4abf-a04c-796236ed5124 could not be found. Jun 16 00:31:44.425272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:31:44.425272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:31:44.425272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:31:44.425272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:31:44.425272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:31:44.425272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:31:44.425272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:31:44.425272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:31:44.425272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:31:44.426508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:31:44.426508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:31:44.426508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:31:44.426508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:31:44.426508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:31:44.426508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:31:44.426508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:31:44.426508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 401cad35-961b-4abf-a04c-796236ed5124 could not be found. Jun 16 00:31:44.426508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:31:44.426508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:31:44.426508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:31:44.426508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:31:44.426508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:31:44.426508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:31:44.426508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:31:44.426508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:31:44.426508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 401cad35-961b-4abf-a04c-796236ed5124 could not be found. Jun 16 00:31:44.426508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:31:44.427539 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-ec35e22e-0cd5-4c7d-b44d-c3e2bd9cf6c8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Returning 404 to user: Instance 401cad35-961b-4abf-a04c-796236ed5124 could not be found. {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:31:44.427539 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-ec35e22e-0cd5-4c7d-b44d-c3e2bd9cf6c8 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124" status: 404 len: 111 microversion: 2.1 time: 0.037506 Jun 16 00:31:44.427539 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 261/532] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:44 2022] GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:31:44.433228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d9dec246-3d7d-42e8-8e5a-fa9c8060df76 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '.version_select at 0x7fe704a7a3a0>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:44.454678 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-d9dec246-3d7d-42e8-8e5a-fa9c8060df76 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-437539695" status: 202 len: 0 microversion: 2.1 time: 0.025156 Jun 16 00:31:44.455301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 272/533] 10.222.0.23 () {58 vars in 1217 bytes} [Thu Jun 16 00:31:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-437539695 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:31:44.911006 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-dd900e19-5403-4a35-b41c-12e9bacaa0e5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:44.911523 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-dd900e19-5403-4a35-b41c-12e9bacaa0e5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:44.917426 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-dd900e19-5403-4a35-b41c-12e9bacaa0e5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:44.918048 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-dd900e19-5403-4a35-b41c-12e9bacaa0e5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:44.918830 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-dd900e19-5403-4a35-b41c-12e9bacaa0e5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:44.919255 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-dd900e19-5403-4a35-b41c-12e9bacaa0e5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:45.060712 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-dd900e19-5403-4a35-b41c-12e9bacaa0e5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:45.069517 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-dd900e19-5403-4a35-b41c-12e9bacaa0e5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:45.071338 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-dd900e19-5403-4a35-b41c-12e9bacaa0e5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:45.072430 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-dd900e19-5403-4a35-b41c-12e9bacaa0e5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1407 microversion: 2.20 time: 0.165508 Jun 16 00:31:45.072986 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 262/534] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:44 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:45.091323 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-ee3fcb9e-32f9-43bd-b70a-67bef4dc79de tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Action: 'create', calling method: .version_select at 0x7fe704b86c10>, body: {"keypair": {"name": "tempest-keypair-870672905", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHxEwStoFYhOFw7dtEi6zncUiKy1uYoaMCAIFCqg7lavhvncoPvzb2TxEHFksFyW3zV3fzwQ/MyhFX2HPJIZBPTLCQ17U0KLWts3tBMfLnQeoPDvLh1VSiAV4tnz2AXNA=="}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:45.106103 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-ee3fcb9e-32f9-43bd-b70a-67bef4dc79de tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Getting quotas for project 2d5d56c0c6444b23a1ac6cc2fcb0bb52. Resources: {'key_pairs'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:31:45.110050 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-ee3fcb9e-32f9-43bd-b70a-67bef4dc79de tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Getting quotas for user 535a03ce19d346d59e6a6f6befb9dea0 and project 2d5d56c0c6444b23a1ac6cc2fcb0bb52. Resources: {'key_pairs'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:31:45.131150 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-ee3fcb9e-32f9-43bd-b70a-67bef4dc79de tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043706 Jun 16 00:31:45.131723 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 273/535] 10.222.0.23 () {60 vars in 1158 bytes} [Thu Jun 16 00:31:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:31:45.314222 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-12ca517c-c0d6-4c82-b243-09540b20dffc req-105ecee9-2c3e-41cc-8b88-0f4032b88537 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86b6066-9081-4634-b4da-e5c5ddd72e9d", "tag": "308b71f6-0824-4328-b466-16c67900f36f"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:45.322476 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-12ca517c-c0d6-4c82-b243-09540b20dffc req-105ecee9-2c3e-41cc-8b88-0f4032b88537 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:45.322948 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-12ca517c-c0d6-4c82-b243-09540b20dffc req-105ecee9-2c3e-41cc-8b88-0f4032b88537 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:45.334462 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-12ca517c-c0d6-4c82-b243-09540b20dffc req-105ecee9-2c3e-41cc-8b88-0f4032b88537 service nova] Creating event network-changed:308b71f6-0824-4328-b466-16c67900f36f for instance d86b6066-9081-4634-b4da-e5c5ddd72e9d on hv-cinder-84599 Jun 16 00:31:45.339285 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-12ca517c-c0d6-4c82-b243-09540b20dffc req-105ecee9-2c3e-41cc-8b88-0f4032b88537 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029494 Jun 16 00:31:45.339868 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 263/536] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:31:46.091078 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d8b71492-0066-41a2-8aef-e9aae2eec46a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:46.091680 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-d8b71492-0066-41a2-8aef-e9aae2eec46a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:46.098441 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d8b71492-0066-41a2-8aef-e9aae2eec46a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:46.098877 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d8b71492-0066-41a2-8aef-e9aae2eec46a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:46.099629 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d8b71492-0066-41a2-8aef-e9aae2eec46a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:46.100056 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d8b71492-0066-41a2-8aef-e9aae2eec46a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:46.240629 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d8b71492-0066-41a2-8aef-e9aae2eec46a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:46.249464 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d8b71492-0066-41a2-8aef-e9aae2eec46a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:46.251099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d8b71492-0066-41a2-8aef-e9aae2eec46a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:46.252274 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-d8b71492-0066-41a2-8aef-e9aae2eec46a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1407 microversion: 2.20 time: 0.165550 Jun 16 00:31:46.252921 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 274/537] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:46 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:46.829392 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-ef562ff7-e4fe-458e-a42e-42c5b5011aba tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-237312961", "imageRef": "d9a6de24-7a5e-4f8b-b078-809c87b15d56", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b338e4d-b5e8-4121-bb8b-45875ebd0e07"}], "security_groups": [{"name": "tempest-securitygroup--255460432"}], "key_name": "tempest-keypair-870672905", "user_data": "}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:46.933005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.network.neutron [None req-ef562ff7-e4fe-458e-a42e-42c5b5011aba tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] validate_networks() for [('5b338e4d-b5e8-4121-bb8b-45875ebd0e07', None, None, None, None, None)] {{(pid=124230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:31:47.270630 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-56e6b3ba-a059-4392-9d82-621c69408cd1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:47.271445 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-56e6b3ba-a059-4392-9d82-621c69408cd1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:47.277893 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-56e6b3ba-a059-4392-9d82-621c69408cd1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:47.278340 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-56e6b3ba-a059-4392-9d82-621c69408cd1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:47.279096 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-56e6b3ba-a059-4392-9d82-621c69408cd1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:47.279527 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-56e6b3ba-a059-4392-9d82-621c69408cd1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:47.296587 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-ef562ff7-e4fe-458e-a42e-42c5b5011aba tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Flavor limits 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:31:47.297065 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-ef562ff7-e4fe-458e-a42e-42c5b5011aba tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Image limits 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:31:47.297528 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-ef562ff7-e4fe-458e-a42e-42c5b5011aba tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Flavor pref 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:31:47.297946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-ef562ff7-e4fe-458e-a42e-42c5b5011aba tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Image pref 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:31:47.298349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-ef562ff7-e4fe-458e-a42e-42c5b5011aba tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:31:47.306967 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ef562ff7-e4fe-458e-a42e-42c5b5011aba tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:47.307401 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ef562ff7-e4fe-458e-a42e-42c5b5011aba tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:47.308179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ef562ff7-e4fe-458e-a42e-42c5b5011aba tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:47.308603 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ef562ff7-e4fe-458e-a42e-42c5b5011aba tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:47.320732 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:47.327091 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-ef562ff7-e4fe-458e-a42e-42c5b5011aba tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Getting quotas for project 2d5d56c0c6444b23a1ac6cc2fcb0bb52. Resources: {'ram', 'cores', 'instances'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:31:47.332774 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-ef562ff7-e4fe-458e-a42e-42c5b5011aba tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Getting quotas for user 535a03ce19d346d59e6a6f6befb9dea0 and project 2d5d56c0c6444b23a1ac6cc2fcb0bb52. Resources: {'ram', 'cores', 'instances'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:31:47.345138 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-ef562ff7-e4fe-458e-a42e-42c5b5011aba tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Going to run 1 instances... {{(pid=124230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:31:47.347498 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-ef562ff7-e4fe-458e-a42e-42c5b5011aba tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d9a6de24-7a5e-4f8b-b078-809c87b15d56',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:31:47.393105 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-ef562ff7-e4fe-458e-a42e-42c5b5011aba tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.569398 Jun 16 00:31:47.393943 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 264/538] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Jun 16 00:31:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:31:47.403546 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-187cd7f5-59b1-4da9-8c28-093564f4cd98 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:47.404149 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-187cd7f5-59b1-4da9-8c28-093564f4cd98 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:47.416813 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-56e6b3ba-a059-4392-9d82-621c69408cd1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:47.426164 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-56e6b3ba-a059-4392-9d82-621c69408cd1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:47.427846 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-56e6b3ba-a059-4392-9d82-621c69408cd1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:47.428985 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-56e6b3ba-a059-4392-9d82-621c69408cd1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1407 microversion: 2.20 time: 0.162520 Jun 16 00:31:47.429709 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 275/539] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:47 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:47.458485 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-187cd7f5-59b1-4da9-8c28-093564f4cd98 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:47.466478 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-187cd7f5-59b1-4da9-8c28-093564f4cd98 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230" status: 200 len: 1240 microversion: 2.1 time: 0.066527 Jun 16 00:31:47.467058 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 265/540] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:47 2022] GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:31:48.447118 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-df8de963-4a95-4dbc-80c5-e0bf8f71d128 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:48.448432 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-df8de963-4a95-4dbc-80c5-e0bf8f71d128 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:48.455724 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-df8de963-4a95-4dbc-80c5-e0bf8f71d128 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:48.456172 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-df8de963-4a95-4dbc-80c5-e0bf8f71d128 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:48.457341 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-df8de963-4a95-4dbc-80c5-e0bf8f71d128 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:48.457788 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-df8de963-4a95-4dbc-80c5-e0bf8f71d128 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:48.484135 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-a6cde2f2-fc2c-487e-b203-62a8bc7a3d0a tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:48.484759 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-a6cde2f2-fc2c-487e-b203-62a8bc7a3d0a tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:48.507117 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a6cde2f2-fc2c-487e-b203-62a8bc7a3d0a tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:48.507581 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a6cde2f2-fc2c-487e-b203-62a8bc7a3d0a tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:48.508584 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a6cde2f2-fc2c-487e-b203-62a8bc7a3d0a tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:48.509055 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a6cde2f2-fc2c-487e-b203-62a8bc7a3d0a tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:48.578787 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a6cde2f2-fc2c-487e-b203-62a8bc7a3d0a tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:48.586198 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-a6cde2f2-fc2c-487e-b203-62a8bc7a3d0a tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230" status: 200 len: 1298 microversion: 2.1 time: 0.106652 Jun 16 00:31:48.586765 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 266/541] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:48 2022] GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230 => generated 1298 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:31:48.597049 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-df8de963-4a95-4dbc-80c5-e0bf8f71d128 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:48.604804 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-df8de963-4a95-4dbc-80c5-e0bf8f71d128 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:48.606307 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-df8de963-4a95-4dbc-80c5-e0bf8f71d128 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:48.607378 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-df8de963-4a95-4dbc-80c5-e0bf8f71d128 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1407 microversion: 2.20 time: 0.164497 Jun 16 00:31:48.607913 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 276/542] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:48 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:49.602625 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-1332564a-5a5f-4733-8e6d-ddd91ac693a1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:49.603330 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-1332564a-5a5f-4733-8e6d-ddd91ac693a1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:49.613913 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1332564a-5a5f-4733-8e6d-ddd91ac693a1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:49.614589 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1332564a-5a5f-4733-8e6d-ddd91ac693a1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:49.615903 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1332564a-5a5f-4733-8e6d-ddd91ac693a1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:49.616551 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1332564a-5a5f-4733-8e6d-ddd91ac693a1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:49.627520 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-c78b325b-6b0b-45c7-b23f-be3127626ec5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:49.628708 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-c78b325b-6b0b-45c7-b23f-be3127626ec5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:49.632027 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=2 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:49.650922 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c78b325b-6b0b-45c7-b23f-be3127626ec5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:49.657462 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c78b325b-6b0b-45c7-b23f-be3127626ec5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:49.658472 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c78b325b-6b0b-45c7-b23f-be3127626ec5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:49.659150 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c78b325b-6b0b-45c7-b23f-be3127626ec5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:49.845810 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-c78b325b-6b0b-45c7-b23f-be3127626ec5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:49.852765 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-1332564a-5a5f-4733-8e6d-ddd91ac693a1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:49.856332 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-c78b325b-6b0b-45c7-b23f-be3127626ec5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:49.857839 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-c78b325b-6b0b-45c7-b23f-be3127626ec5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:49.859465 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-c78b325b-6b0b-45c7-b23f-be3127626ec5 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1407 microversion: 2.20 time: 0.237793 Jun 16 00:31:49.860037 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 277/543] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:49 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:49.861015 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-1332564a-5a5f-4733-8e6d-ddd91ac693a1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230" status: 200 len: 1365 microversion: 2.1 time: 0.262221 Jun 16 00:31:49.861794 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 267/544] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:49 2022] GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230 => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:50.187996 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-479696c6-84c5-4f44-8f7d-5627caf52f9e req-6d92e9f7-c01d-473b-bb51-58328014347c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01d77a9c-3658-4db2-ab07-b248d1c7a230", "tag": "40cf5e59-5b43-4cfc-b0ac-9b7bcf0e5df3"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:50.198740 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-479696c6-84c5-4f44-8f7d-5627caf52f9e req-6d92e9f7-c01d-473b-bb51-58328014347c service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:50.199170 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-479696c6-84c5-4f44-8f7d-5627caf52f9e req-6d92e9f7-c01d-473b-bb51-58328014347c service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:50.211695 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-479696c6-84c5-4f44-8f7d-5627caf52f9e req-6d92e9f7-c01d-473b-bb51-58328014347c service nova] Creating event network-changed:40cf5e59-5b43-4cfc-b0ac-9b7bcf0e5df3 for instance 01d77a9c-3658-4db2-ab07-b248d1c7a230 on hv-cinder-84599 Jun 16 00:31:50.216593 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-479696c6-84c5-4f44-8f7d-5627caf52f9e req-6d92e9f7-c01d-473b-bb51-58328014347c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032430 Jun 16 00:31:50.217487 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 278/545] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:31:50.877895 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-e19f2f2b-a17c-4fa0-b302-df0a6643a785 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:50.878490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-e19f2f2b-a17c-4fa0-b302-df0a6643a785 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:50.878938 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-3a03c681-94c3-4b4c-8567-cb000fee818e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:50.879628 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-3a03c681-94c3-4b4c-8567-cb000fee818e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:50.885061 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e19f2f2b-a17c-4fa0-b302-df0a6643a785 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:50.885509 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e19f2f2b-a17c-4fa0-b302-df0a6643a785 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:50.885711 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3a03c681-94c3-4b4c-8567-cb000fee818e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:50.886153 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3a03c681-94c3-4b4c-8567-cb000fee818e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:50.886249 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e19f2f2b-a17c-4fa0-b302-df0a6643a785 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:50.886672 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e19f2f2b-a17c-4fa0-b302-df0a6643a785 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:50.886898 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3a03c681-94c3-4b4c-8567-cb000fee818e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:50.887321 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3a03c681-94c3-4b4c-8567-cb000fee818e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:51.017220 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-3a03c681-94c3-4b4c-8567-cb000fee818e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:51.020984 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:51.025103 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-e19f2f2b-a17c-4fa0-b302-df0a6643a785 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:51.026641 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-3a03c681-94c3-4b4c-8567-cb000fee818e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:51.028125 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-3a03c681-94c3-4b4c-8567-cb000fee818e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:51.029245 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-3a03c681-94c3-4b4c-8567-cb000fee818e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1407 microversion: 2.20 time: 0.155468 Jun 16 00:31:51.029802 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 279/546] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:50 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:51.033260 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-e19f2f2b-a17c-4fa0-b302-df0a6643a785 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230" status: 200 len: 1365 microversion: 2.1 time: 0.159732 Jun 16 00:31:51.033935 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 268/547] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:50 2022] GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:51.236288 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-8872f1b9-affc-4797-bd53-ba6e49b96288 req-819fff7b-3308-4869-82ab-de2145131875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86b6066-9081-4634-b4da-e5c5ddd72e9d", "name": "network-vif-plugged", "status": "completed", "tag": "308b71f6-0824-4328-b466-16c67900f36f"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:51.247768 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-8872f1b9-affc-4797-bd53-ba6e49b96288 req-819fff7b-3308-4869-82ab-de2145131875 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:51.248490 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-8872f1b9-affc-4797-bd53-ba6e49b96288 req-819fff7b-3308-4869-82ab-de2145131875 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:51.260181 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-8872f1b9-affc-4797-bd53-ba6e49b96288 req-819fff7b-3308-4869-82ab-de2145131875 service nova] Creating event network-vif-plugged:308b71f6-0824-4328-b466-16c67900f36f for instance d86b6066-9081-4634-b4da-e5c5ddd72e9d on hv-cinder-84599 Jun 16 00:31:51.265414 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-8872f1b9-affc-4797-bd53-ba6e49b96288 req-819fff7b-3308-4869-82ab-de2145131875 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032945 Jun 16 00:31:51.265673 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 280/548] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:31:52.046679 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c379f449-890b-4a44-9f4f-26c669217791 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:52.047274 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c379f449-890b-4a44-9f4f-26c669217791 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:52.050210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-5926a1df-dfdb-49a5-9c49-86c1f23a1664 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:52.050943 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-5926a1df-dfdb-49a5-9c49-86c1f23a1664 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:52.053810 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c379f449-890b-4a44-9f4f-26c669217791 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:52.054248 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c379f449-890b-4a44-9f4f-26c669217791 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:52.054998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c379f449-890b-4a44-9f4f-26c669217791 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:52.055422 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c379f449-890b-4a44-9f4f-26c669217791 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:52.057697 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5926a1df-dfdb-49a5-9c49-86c1f23a1664 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:52.058147 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5926a1df-dfdb-49a5-9c49-86c1f23a1664 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:52.058912 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5926a1df-dfdb-49a5-9c49-86c1f23a1664 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:52.059344 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5926a1df-dfdb-49a5-9c49-86c1f23a1664 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:52.196166 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-5926a1df-dfdb-49a5-9c49-86c1f23a1664 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:52.204532 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-5926a1df-dfdb-49a5-9c49-86c1f23a1664 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230" status: 200 len: 1365 microversion: 2.1 time: 0.158572 Jun 16 00:31:52.205231 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 281/549] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:52 2022] GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:31:52.287138 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c379f449-890b-4a44-9f4f-26c669217791 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:52.295181 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c379f449-890b-4a44-9f4f-26c669217791 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:52.297358 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c379f449-890b-4a44-9f4f-26c669217791 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:52.298500 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c379f449-890b-4a44-9f4f-26c669217791 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1407 microversion: 2.20 time: 0.255805 Jun 16 00:31:52.299051 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 269/550] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:52 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:53.221827 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-59ce94d8-200d-4ac3-8f97-aff4280759bb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:53.222446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-59ce94d8-200d-4ac3-8f97-aff4280759bb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:53.229112 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59ce94d8-200d-4ac3-8f97-aff4280759bb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:53.229582 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59ce94d8-200d-4ac3-8f97-aff4280759bb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:53.230589 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59ce94d8-200d-4ac3-8f97-aff4280759bb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:53.231068 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59ce94d8-200d-4ac3-8f97-aff4280759bb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:53.316425 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-9666e0a0-5eb4-4ac0-845a-f25ad35ed3ee tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:53.317556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-9666e0a0-5eb4-4ac0-845a-f25ad35ed3ee tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:53.324001 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9666e0a0-5eb4-4ac0-845a-f25ad35ed3ee tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:53.324457 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9666e0a0-5eb4-4ac0-845a-f25ad35ed3ee tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:53.325338 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9666e0a0-5eb4-4ac0-845a-f25ad35ed3ee tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:53.325778 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9666e0a0-5eb4-4ac0-845a-f25ad35ed3ee tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:53.330701 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:53.370521 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-59ce94d8-200d-4ac3-8f97-aff4280759bb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:53.378829 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-59ce94d8-200d-4ac3-8f97-aff4280759bb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230" status: 200 len: 1365 microversion: 2.1 time: 0.161516 Jun 16 00:31:53.379416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 282/551] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:53 2022] GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:53.466749 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-9666e0a0-5eb4-4ac0-845a-f25ad35ed3ee tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:53.474974 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-9666e0a0-5eb4-4ac0-845a-f25ad35ed3ee tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:53.476465 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-9666e0a0-5eb4-4ac0-845a-f25ad35ed3ee tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:53.477587 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-9666e0a0-5eb4-4ac0-845a-f25ad35ed3ee tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1407 microversion: 2.20 time: 0.165417 Jun 16 00:31:53.478133 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 270/552] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:53 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:54.395981 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-34efc070-82a8-4eea-98ab-afed93712c31 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:54.396589 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-34efc070-82a8-4eea-98ab-afed93712c31 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:54.403115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-34efc070-82a8-4eea-98ab-afed93712c31 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:54.403556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-34efc070-82a8-4eea-98ab-afed93712c31 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:54.404312 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-34efc070-82a8-4eea-98ab-afed93712c31 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:54.404741 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-34efc070-82a8-4eea-98ab-afed93712c31 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:54.494337 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-9e3137f0-eee5-47ae-abc9-469d7a979c3f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:54.494940 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-9e3137f0-eee5-47ae-abc9-469d7a979c3f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:54.501649 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9e3137f0-eee5-47ae-abc9-469d7a979c3f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:54.502093 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9e3137f0-eee5-47ae-abc9-469d7a979c3f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:54.502855 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9e3137f0-eee5-47ae-abc9-469d7a979c3f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:54.503282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9e3137f0-eee5-47ae-abc9-469d7a979c3f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:54.536479 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-34efc070-82a8-4eea-98ab-afed93712c31 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:54.544137 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-34efc070-82a8-4eea-98ab-afed93712c31 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230" status: 200 len: 1365 microversion: 2.1 time: 0.152255 Jun 16 00:31:54.544708 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 283/553] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:54 2022] GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:54.629540 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-9e3137f0-eee5-47ae-abc9-469d7a979c3f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:54.638405 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-9e3137f0-eee5-47ae-abc9-469d7a979c3f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:54.639962 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-9e3137f0-eee5-47ae-abc9-469d7a979c3f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:54.642356 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-9e3137f0-eee5-47ae-abc9-469d7a979c3f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1600 microversion: 2.20 time: 0.151469 Jun 16 00:31:54.642915 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 271/554] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:54 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:54.660132 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-72657df8-f8b5-456f-b8a4-b3ce3f609883 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:54.660647 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-72657df8-f8b5-456f-b8a4-b3ce3f609883 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:54.666571 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-72657df8-f8b5-456f-b8a4-b3ce3f609883 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:54.667008 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-72657df8-f8b5-456f-b8a4-b3ce3f609883 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:54.667744 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-72657df8-f8b5-456f-b8a4-b3ce3f609883 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:54.668169 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-72657df8-f8b5-456f-b8a4-b3ce3f609883 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:54.773602 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-19692d9e-f251-494a-9dc5-1da9fc15645a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:54.774522 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-19692d9e-f251-494a-9dc5-1da9fc15645a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:54.780796 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-19692d9e-f251-494a-9dc5-1da9fc15645a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:54.781327 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-19692d9e-f251-494a-9dc5-1da9fc15645a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:54.782612 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-19692d9e-f251-494a-9dc5-1da9fc15645a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:54.783037 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-19692d9e-f251-494a-9dc5-1da9fc15645a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:54.860862 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-19692d9e-f251-494a-9dc5-1da9fc15645a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "POST /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c/action" status: 202 len: 0 microversion: 2.1 time: 0.091042 Jun 16 00:31:54.862132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 272/555] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Jun 16 00:31:54 2022] POST /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 00:31:54.874501 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-ceaa6b51-130c-42cf-a078-d9440350933d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:54.876484 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-ceaa6b51-130c-42cf-a078-d9440350933d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:54.887846 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ceaa6b51-130c-42cf-a078-d9440350933d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:54.888608 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ceaa6b51-130c-42cf-a078-d9440350933d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:54.889950 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ceaa6b51-130c-42cf-a078-d9440350933d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:54.891361 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ceaa6b51-130c-42cf-a078-d9440350933d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:54.962821 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-72657df8-f8b5-456f-b8a4-b3ce3f609883 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.307043 Jun 16 00:31:54.963504 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 284/556] 10.222.0.23 () {60 vars in 1315 bytes} [Thu Jun 16 00:31:54 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d/os-interface => generated 285 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:31:55.137543 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-ceaa6b51-130c-42cf-a078-d9440350933d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:55.152624 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-ceaa6b51-130c-42cf-a078-d9440350933d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1750 microversion: 2.1 time: 0.285059 Jun 16 00:31:55.161419 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 273/557] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:54 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1750 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:31:55.253797 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-2c42d501-0d5c-4167-bb0f-e1bb28589448 req-60c5c212-102a-4621-bc8f-26a189fb5cca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01d77a9c-3658-4db2-ab07-b248d1c7a230", "name": "network-vif-plugged", "status": "completed", "tag": "40cf5e59-5b43-4cfc-b0ac-9b7bcf0e5df3"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:55.261201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=10 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:55.268094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-2c42d501-0d5c-4167-bb0f-e1bb28589448 req-60c5c212-102a-4621-bc8f-26a189fb5cca service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:55.268687 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-2c42d501-0d5c-4167-bb0f-e1bb28589448 req-60c5c212-102a-4621-bc8f-26a189fb5cca service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:55.287055 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-2c42d501-0d5c-4167-bb0f-e1bb28589448 req-60c5c212-102a-4621-bc8f-26a189fb5cca service nova] Creating event network-vif-plugged:40cf5e59-5b43-4cfc-b0ac-9b7bcf0e5df3 for instance 01d77a9c-3658-4db2-ab07-b248d1c7a230 on hv-cinder-84599 Jun 16 00:31:55.293771 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-2c42d501-0d5c-4167-bb0f-e1bb28589448 req-60c5c212-102a-4621-bc8f-26a189fb5cca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044101 Jun 16 00:31:55.296156 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 285/558] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:31:55.565042 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c0cef8a1-0cc5-4fb4-a7f3-808e4feda62b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:55.566245 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c0cef8a1-0cc5-4fb4-a7f3-808e4feda62b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:55.581101 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c0cef8a1-0cc5-4fb4-a7f3-808e4feda62b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:55.582066 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c0cef8a1-0cc5-4fb4-a7f3-808e4feda62b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:55.582904 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c0cef8a1-0cc5-4fb4-a7f3-808e4feda62b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:55.583404 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c0cef8a1-0cc5-4fb4-a7f3-808e4feda62b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:55.721819 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c0cef8a1-0cc5-4fb4-a7f3-808e4feda62b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:55.729317 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c0cef8a1-0cc5-4fb4-a7f3-808e4feda62b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230" status: 200 len: 1365 microversion: 2.1 time: 0.171588 Jun 16 00:31:55.729878 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 274/559] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:55 2022] GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:55.932499 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-50998c1a-24df-4493-aa50-c18fec6a023a req-deb5f102-0720-4b38-bee8-2e486ca8ae22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86b6066-9081-4634-b4da-e5c5ddd72e9d", "tag": "308b71f6-0824-4328-b466-16c67900f36f"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:55.941675 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-50998c1a-24df-4493-aa50-c18fec6a023a req-deb5f102-0720-4b38-bee8-2e486ca8ae22 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:55.942111 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-50998c1a-24df-4493-aa50-c18fec6a023a req-deb5f102-0720-4b38-bee8-2e486ca8ae22 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:55.953903 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-50998c1a-24df-4493-aa50-c18fec6a023a req-deb5f102-0720-4b38-bee8-2e486ca8ae22 service nova] Creating event network-changed:308b71f6-0824-4328-b466-16c67900f36f for instance d86b6066-9081-4634-b4da-e5c5ddd72e9d on hv-cinder-84599 Jun 16 00:31:55.958772 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-50998c1a-24df-4493-aa50-c18fec6a023a req-deb5f102-0720-4b38-bee8-2e486ca8ae22 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030586 Jun 16 00:31:55.959677 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 286/560] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:31:56.170933 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-e1d44f0a-869d-48c3-b586-73202e1f5a0b tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:56.171444 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-e1d44f0a-869d-48c3-b586-73202e1f5a0b tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:56.177952 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e1d44f0a-869d-48c3-b586-73202e1f5a0b tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:56.178403 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e1d44f0a-869d-48c3-b586-73202e1f5a0b tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:56.179148 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e1d44f0a-869d-48c3-b586-73202e1f5a0b tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:56.179574 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e1d44f0a-869d-48c3-b586-73202e1f5a0b tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:56.324660 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-e1d44f0a-869d-48c3-b586-73202e1f5a0b tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:56.333705 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-e1d44f0a-869d-48c3-b586-73202e1f5a0b tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1755 microversion: 2.1 time: 0.166673 Jun 16 00:31:56.334267 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 275/561] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:56 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:56.746864 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-215ee31f-66ea-4105-8162-451b8631ca15 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:56.747563 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-215ee31f-66ea-4105-8162-451b8631ca15 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:56.754691 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-215ee31f-66ea-4105-8162-451b8631ca15 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:56.755140 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-215ee31f-66ea-4105-8162-451b8631ca15 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:56.755910 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-215ee31f-66ea-4105-8162-451b8631ca15 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:56.756339 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-215ee31f-66ea-4105-8162-451b8631ca15 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:56.906898 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-215ee31f-66ea-4105-8162-451b8631ca15 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:56.914581 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-215ee31f-66ea-4105-8162-451b8631ca15 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230" status: 200 len: 1365 microversion: 2.1 time: 0.171943 Jun 16 00:31:56.915168 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 287/562] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:56 2022] GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:57.350973 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-850bb2af-5886-47fb-b159-6af9ae56f8a8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:57.351561 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-850bb2af-5886-47fb-b159-6af9ae56f8a8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:57.353981 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=2 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:57.359961 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-850bb2af-5886-47fb-b159-6af9ae56f8a8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:57.360588 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-850bb2af-5886-47fb-b159-6af9ae56f8a8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:57.361376 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-850bb2af-5886-47fb-b159-6af9ae56f8a8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:57.361807 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-850bb2af-5886-47fb-b159-6af9ae56f8a8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:57.466274 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=14 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:57.591172 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-850bb2af-5886-47fb-b159-6af9ae56f8a8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:57.600568 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-850bb2af-5886-47fb-b159-6af9ae56f8a8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1755 microversion: 2.1 time: 0.253395 Jun 16 00:31:57.601217 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 276/563] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:57 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1755 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:57.931372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-bf70f93e-e6c0-4541-b215-2661938be55d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:57.931983 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-bf70f93e-e6c0-4541-b215-2661938be55d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:57.947149 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-bf70f93e-e6c0-4541-b215-2661938be55d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:57.947595 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-bf70f93e-e6c0-4541-b215-2661938be55d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:57.948363 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-bf70f93e-e6c0-4541-b215-2661938be55d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:57.948793 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-bf70f93e-e6c0-4541-b215-2661938be55d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:58.082271 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-bf70f93e-e6c0-4541-b215-2661938be55d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:58.089763 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-bf70f93e-e6c0-4541-b215-2661938be55d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230" status: 200 len: 1555 microversion: 2.1 time: 0.162389 Jun 16 00:31:58.090325 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 288/564] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:57 2022] GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:58.105833 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-de10b961-2cd1-470b-aec3-0df8755a08ca tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:58.106319 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-de10b961-2cd1-470b-aec3-0df8755a08ca tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:58.112481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-de10b961-2cd1-470b-aec3-0df8755a08ca tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:58.112949 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-de10b961-2cd1-470b-aec3-0df8755a08ca tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:58.113693 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-de10b961-2cd1-470b-aec3-0df8755a08ca tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:58.114117 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-de10b961-2cd1-470b-aec3-0df8755a08ca tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:58.191665 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-de10b961-2cd1-470b-aec3-0df8755a08ca tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089540 Jun 16 00:31:58.197925 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 277/565] 10.222.0.23 () {58 vars in 1274 bytes} [Thu Jun 16 00:31:58 2022] GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:31:58.618124 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-cdcedb5b-de05-4cc0-a9b4-34801d212e31 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:58.618725 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-cdcedb5b-de05-4cc0-a9b4-34801d212e31 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:58.624629 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cdcedb5b-de05-4cc0-a9b4-34801d212e31 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:58.625145 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cdcedb5b-de05-4cc0-a9b4-34801d212e31 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:58.625927 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cdcedb5b-de05-4cc0-a9b4-34801d212e31 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:58.626353 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cdcedb5b-de05-4cc0-a9b4-34801d212e31 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:58.771878 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-cdcedb5b-de05-4cc0-a9b4-34801d212e31 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:58.779866 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-cdcedb5b-de05-4cc0-a9b4-34801d212e31 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1755 microversion: 2.1 time: 0.165560 Jun 16 00:31:58.780734 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 289/566] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:58 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:59.089937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-a1b000f8-ca1d-4a81-bbe8-31cc18f555c2 req-020c74b4-7756-4719-a12b-f6f72101fe29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01d77a9c-3658-4db2-ab07-b248d1c7a230", "tag": "40cf5e59-5b43-4cfc-b0ac-9b7bcf0e5df3"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:59.099170 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-a1b000f8-ca1d-4a81-bbe8-31cc18f555c2 req-020c74b4-7756-4719-a12b-f6f72101fe29 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:59.099608 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-a1b000f8-ca1d-4a81-bbe8-31cc18f555c2 req-020c74b4-7756-4719-a12b-f6f72101fe29 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:59.111087 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-a1b000f8-ca1d-4a81-bbe8-31cc18f555c2 req-020c74b4-7756-4719-a12b-f6f72101fe29 service nova] Creating event network-changed:40cf5e59-5b43-4cfc-b0ac-9b7bcf0e5df3 for instance 01d77a9c-3658-4db2-ab07-b248d1c7a230 on hv-cinder-84599 Jun 16 00:31:59.115848 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-a1b000f8-ca1d-4a81-bbe8-31cc18f555c2 req-020c74b4-7756-4719-a12b-f6f72101fe29 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029976 Jun 16 00:31:59.116526 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 278/567] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:31:59.798426 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-e56b3b82-a57e-4772-97f0-e608e993b456 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:59.799030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-e56b3b82-a57e-4772-97f0-e608e993b456 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:59.805940 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e56b3b82-a57e-4772-97f0-e608e993b456 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:59.806970 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e56b3b82-a57e-4772-97f0-e608e993b456 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:59.807598 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e56b3b82-a57e-4772-97f0-e608e993b456 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:59.808083 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e56b3b82-a57e-4772-97f0-e608e993b456 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:59.966453 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-e56b3b82-a57e-4772-97f0-e608e993b456 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:59.974725 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-e56b3b82-a57e-4772-97f0-e608e993b456 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1755 microversion: 2.1 time: 0.180831 Jun 16 00:31:59.975295 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 290/568] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:59 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:00.993581 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-f2e9917e-7c8d-4b51-9414-3a187dfe2d25 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:00.994184 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-f2e9917e-7c8d-4b51-9414-3a187dfe2d25 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:01.000286 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f2e9917e-7c8d-4b51-9414-3a187dfe2d25 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:01.000723 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f2e9917e-7c8d-4b51-9414-3a187dfe2d25 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:01.001488 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f2e9917e-7c8d-4b51-9414-3a187dfe2d25 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:01.001916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f2e9917e-7c8d-4b51-9414-3a187dfe2d25 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:01.148163 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f2e9917e-7c8d-4b51-9414-3a187dfe2d25 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:01.156660 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-f2e9917e-7c8d-4b51-9414-3a187dfe2d25 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1755 microversion: 2.1 time: 0.167300 Jun 16 00:32:01.157250 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 279/569] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:00 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:02.174479 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-438854c7-01d3-4af5-b4af-8f3837d3acb0 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:02.175025 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-438854c7-01d3-4af5-b4af-8f3837d3acb0 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:02.181684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-438854c7-01d3-4af5-b4af-8f3837d3acb0 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:02.182136 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-438854c7-01d3-4af5-b4af-8f3837d3acb0 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:02.182892 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-438854c7-01d3-4af5-b4af-8f3837d3acb0 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:02.183329 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-438854c7-01d3-4af5-b4af-8f3837d3acb0 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:02.438350 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-438854c7-01d3-4af5-b4af-8f3837d3acb0 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:02.446435 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-438854c7-01d3-4af5-b4af-8f3837d3acb0 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1755 microversion: 2.1 time: 0.276549 Jun 16 00:32:02.447007 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 291/570] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:02 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1755 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:03.464156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-4d486580-bb4b-429a-9dea-f76f8c253e55 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:03.464760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-4d486580-bb4b-429a-9dea-f76f8c253e55 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:03.472254 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4d486580-bb4b-429a-9dea-f76f8c253e55 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:03.472698 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4d486580-bb4b-429a-9dea-f76f8c253e55 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:03.473477 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4d486580-bb4b-429a-9dea-f76f8c253e55 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:03.473908 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4d486580-bb4b-429a-9dea-f76f8c253e55 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:03.673594 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-4d486580-bb4b-429a-9dea-f76f8c253e55 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:03.681411 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-4d486580-bb4b-429a-9dea-f76f8c253e55 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1755 microversion: 2.1 time: 0.221088 Jun 16 00:32:03.681969 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 280/571] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:03 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1755 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:04.698459 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-598cf7db-4a29-4733-bf2f-1e64113a2d9f tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:04.699062 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-598cf7db-4a29-4733-bf2f-1e64113a2d9f tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:04.706395 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-598cf7db-4a29-4733-bf2f-1e64113a2d9f tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:04.706834 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-598cf7db-4a29-4733-bf2f-1e64113a2d9f tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:04.707587 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-598cf7db-4a29-4733-bf2f-1e64113a2d9f tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:04.708010 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-598cf7db-4a29-4733-bf2f-1e64113a2d9f tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:04.849184 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-598cf7db-4a29-4733-bf2f-1e64113a2d9f tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:04.857018 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-598cf7db-4a29-4733-bf2f-1e64113a2d9f tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1755 microversion: 2.1 time: 0.162387 Jun 16 00:32:04.857577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 292/572] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:04 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:05.873039 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-4977c13e-3f92-42ad-9547-f1f61bf12748 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:05.873649 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-4977c13e-3f92-42ad-9547-f1f61bf12748 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:05.881803 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4977c13e-3f92-42ad-9547-f1f61bf12748 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:05.882245 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4977c13e-3f92-42ad-9547-f1f61bf12748 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:05.883001 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4977c13e-3f92-42ad-9547-f1f61bf12748 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:05.883426 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4977c13e-3f92-42ad-9547-f1f61bf12748 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:06.033322 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-4977c13e-3f92-42ad-9547-f1f61bf12748 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:06.041227 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-4977c13e-3f92-42ad-9547-f1f61bf12748 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1755 microversion: 2.1 time: 0.171987 Jun 16 00:32:06.041797 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 281/573] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:05 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:07.058763 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-0bd4c986-f52a-458d-a09b-c62ff3eea52d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:07.059367 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-0bd4c986-f52a-458d-a09b-c62ff3eea52d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:07.066390 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0bd4c986-f52a-458d-a09b-c62ff3eea52d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:07.066830 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0bd4c986-f52a-458d-a09b-c62ff3eea52d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:07.067576 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0bd4c986-f52a-458d-a09b-c62ff3eea52d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:07.068001 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0bd4c986-f52a-458d-a09b-c62ff3eea52d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:07.206045 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-0bd4c986-f52a-458d-a09b-c62ff3eea52d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:07.213871 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-0bd4c986-f52a-458d-a09b-c62ff3eea52d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1755 microversion: 2.1 time: 0.158975 Jun 16 00:32:07.214426 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 293/574] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:07 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:08.230884 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-6696924e-0676-4e4b-90f9-a442fc70948a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:08.231599 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-6696924e-0676-4e4b-90f9-a442fc70948a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:08.238926 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6696924e-0676-4e4b-90f9-a442fc70948a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:08.239381 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6696924e-0676-4e4b-90f9-a442fc70948a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:08.240155 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6696924e-0676-4e4b-90f9-a442fc70948a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:08.240608 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6696924e-0676-4e4b-90f9-a442fc70948a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:08.383940 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-6696924e-0676-4e4b-90f9-a442fc70948a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:08.392668 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-6696924e-0676-4e4b-90f9-a442fc70948a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1755 microversion: 2.1 time: 0.165643 Jun 16 00:32:08.393252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 282/575] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:08 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:09.411024 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-2fa995ca-a493-4410-90f8-2c9f495f3d7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:09.411562 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-2fa995ca-a493-4410-90f8-2c9f495f3d7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:09.418021 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2fa995ca-a493-4410-90f8-2c9f495f3d7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:09.418459 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2fa995ca-a493-4410-90f8-2c9f495f3d7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:09.419203 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2fa995ca-a493-4410-90f8-2c9f495f3d7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:09.419626 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2fa995ca-a493-4410-90f8-2c9f495f3d7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:09.564306 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-2fa995ca-a493-4410-90f8-2c9f495f3d7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:09.572239 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-2fa995ca-a493-4410-90f8-2c9f495f3d7a tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1755 microversion: 2.1 time: 0.165150 Jun 16 00:32:09.572800 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 294/576] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:09 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:32:10.589606 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-590a27c8-3445-43f6-9162-b8d847031405 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:10.590234 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-590a27c8-3445-43f6-9162-b8d847031405 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:10.597341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-590a27c8-3445-43f6-9162-b8d847031405 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:10.597781 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-590a27c8-3445-43f6-9162-b8d847031405 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:10.598525 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-590a27c8-3445-43f6-9162-b8d847031405 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:10.598947 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-590a27c8-3445-43f6-9162-b8d847031405 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:10.754612 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-590a27c8-3445-43f6-9162-b8d847031405 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:10.762433 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-590a27c8-3445-43f6-9162-b8d847031405 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1755 microversion: 2.1 time: 0.176652 Jun 16 00:32:10.762984 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 283/577] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:10 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:10.977014 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-233c638f-d453-44fe-9515-aada4c32547c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:10.977568 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-233c638f-d453-44fe-9515-aada4c32547c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:10.985038 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-233c638f-d453-44fe-9515-aada4c32547c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:10.985484 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-233c638f-d453-44fe-9515-aada4c32547c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:10.986229 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-233c638f-d453-44fe-9515-aada4c32547c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:10.986657 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-233c638f-d453-44fe-9515-aada4c32547c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:11.069950 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.objects.instance [None req-233c638f-d453-44fe-9515-aada4c32547c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lazy-loading 'services' on Instance uuid 8298735b-2311-40d2-9261-ba64afe3b7fe {{(pid=124231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:32:11.143397 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-233c638f-d453-44fe-9515-aada4c32547c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe/os-volume_attachments/ff5b4ce4-bc3f-41ae-9d82-2a0ab8b6e15d" status: 202 len: 0 microversion: 2.1 time: 0.170151 Jun 16 00:32:11.144549 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 295/578] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Jun 16 00:32:10 2022] DELETE /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe/os-volume_attachments/ff5b4ce4-bc3f-41ae-9d82-2a0ab8b6e15d => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:32:11.152788 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5244a39d-9a69-42f4-9584-83d607f53254 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:11.153746 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-5244a39d-9a69-42f4-9584-83d607f53254 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:11.160695 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5244a39d-9a69-42f4-9584-83d607f53254 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:11.161172 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5244a39d-9a69-42f4-9584-83d607f53254 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:11.161940 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5244a39d-9a69-42f4-9584-83d607f53254 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:11.162360 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5244a39d-9a69-42f4-9584-83d607f53254 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:11.191467 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-5244a39d-9a69-42f4-9584-83d607f53254 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042532 Jun 16 00:32:11.192035 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 284/579] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Jun 16 00:32:11 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:32:11.781015 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-864e3f43-f0b3-4c7d-8917-1590b632677e tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:11.781702 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-864e3f43-f0b3-4c7d-8917-1590b632677e tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:11.787878 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-864e3f43-f0b3-4c7d-8917-1590b632677e tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:11.788317 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-864e3f43-f0b3-4c7d-8917-1590b632677e tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:11.789082 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-864e3f43-f0b3-4c7d-8917-1590b632677e tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:11.789508 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-864e3f43-f0b3-4c7d-8917-1590b632677e tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:11.942520 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-864e3f43-f0b3-4c7d-8917-1590b632677e tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:11.951073 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-864e3f43-f0b3-4c7d-8917-1590b632677e tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1755 microversion: 2.1 time: 0.174830 Jun 16 00:32:11.951635 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 296/580] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:11 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:12.203203 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-7589db51-6d18-41d5-b90d-2f74d4d051f8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:12.204143 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-7589db51-6d18-41d5-b90d-2f74d4d051f8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:12.210580 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7589db51-6d18-41d5-b90d-2f74d4d051f8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:12.211028 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7589db51-6d18-41d5-b90d-2f74d4d051f8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:12.211787 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7589db51-6d18-41d5-b90d-2f74d4d051f8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:12.212217 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7589db51-6d18-41d5-b90d-2f74d4d051f8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:12.241963 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-7589db51-6d18-41d5-b90d-2f74d4d051f8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042905 Jun 16 00:32:12.242514 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 285/581] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Jun 16 00:32:12 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:32:12.969004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-51cdc987-e460-4a66-b001-cfb38b739802 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:12.969669 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-51cdc987-e460-4a66-b001-cfb38b739802 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:12.976094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-51cdc987-e460-4a66-b001-cfb38b739802 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:12.976528 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-51cdc987-e460-4a66-b001-cfb38b739802 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:12.977297 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-51cdc987-e460-4a66-b001-cfb38b739802 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:12.977722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-51cdc987-e460-4a66-b001-cfb38b739802 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:13.119843 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-51cdc987-e460-4a66-b001-cfb38b739802 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:13.128297 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-51cdc987-e460-4a66-b001-cfb38b739802 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1758 microversion: 2.1 time: 0.163345 Jun 16 00:32:13.128854 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 297/582] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:12 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:13.253334 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-3be8f741-c823-40c4-b360-e27f2554f5d3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:13.254168 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-3be8f741-c823-40c4-b360-e27f2554f5d3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:13.260473 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3be8f741-c823-40c4-b360-e27f2554f5d3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:13.260944 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3be8f741-c823-40c4-b360-e27f2554f5d3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:13.261688 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3be8f741-c823-40c4-b360-e27f2554f5d3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:13.262111 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3be8f741-c823-40c4-b360-e27f2554f5d3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:13.286962 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:13.291516 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-3be8f741-c823-40c4-b360-e27f2554f5d3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042917 Jun 16 00:32:13.292060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 286/583] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Jun 16 00:32:13 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:32:13.361286 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-83b4cd9c-ad86-43e6-91bb-d00efbc4c481 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:13.361864 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-83b4cd9c-ad86-43e6-91bb-d00efbc4c481 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:13.363966 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:13.369179 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-83b4cd9c-ad86-43e6-91bb-d00efbc4c481 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:13.369620 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-83b4cd9c-ad86-43e6-91bb-d00efbc4c481 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:13.370374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-83b4cd9c-ad86-43e6-91bb-d00efbc4c481 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:13.370796 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-83b4cd9c-ad86-43e6-91bb-d00efbc4c481 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:13.376112 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:13.398625 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-83b4cd9c-ad86-43e6-91bb-d00efbc4c481 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Going to try to terminate instance {{(pid=124231) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:32:13.471425 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-83b4cd9c-ad86-43e6-91bb-d00efbc4c481 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 204 len: 0 microversion: 2.1 time: 0.114228 Jun 16 00:32:13.472238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 298/584] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:32:13 2022] DELETE /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:32:13.480176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-3b9cae37-c680-4d91-b323-260e00a2593e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:13.480787 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-3b9cae37-c680-4d91-b323-260e00a2593e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:13.488432 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3b9cae37-c680-4d91-b323-260e00a2593e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:13.488894 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3b9cae37-c680-4d91-b323-260e00a2593e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:13.489656 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3b9cae37-c680-4d91-b323-260e00a2593e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:13.490089 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3b9cae37-c680-4d91-b323-260e00a2593e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:13.618819 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-3b9cae37-c680-4d91-b323-260e00a2593e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:13.626841 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-3b9cae37-c680-4d91-b323-260e00a2593e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1689 microversion: 2.1 time: 0.150586 Jun 16 00:32:13.627397 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 287/585] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:13 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:32:14.646297 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-773a0354-bb99-4362-9ee2-7149a4f7ed0f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:14.646996 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-773a0354-bb99-4362-9ee2-7149a4f7ed0f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:14.653418 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-773a0354-bb99-4362-9ee2-7149a4f7ed0f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:14.653860 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-773a0354-bb99-4362-9ee2-7149a4f7ed0f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:14.654615 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-773a0354-bb99-4362-9ee2-7149a4f7ed0f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:14.655049 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-773a0354-bb99-4362-9ee2-7149a4f7ed0f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:14.784043 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-773a0354-bb99-4362-9ee2-7149a4f7ed0f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:14.791540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-773a0354-bb99-4362-9ee2-7149a4f7ed0f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1689 microversion: 2.1 time: 0.149775 Jun 16 00:32:14.792098 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 299/586] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:14 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:15.810890 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-65751eb4-7af1-4252-8da0-6669b7ff74ba tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:15.812068 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-65751eb4-7af1-4252-8da0-6669b7ff74ba tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:15.818945 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-65751eb4-7af1-4252-8da0-6669b7ff74ba tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:15.819393 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-65751eb4-7af1-4252-8da0-6669b7ff74ba tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:15.820154 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-65751eb4-7af1-4252-8da0-6669b7ff74ba tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:15.820586 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-65751eb4-7af1-4252-8da0-6669b7ff74ba tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:15.960842 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-65751eb4-7af1-4252-8da0-6669b7ff74ba tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:15.969224 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-65751eb4-7af1-4252-8da0-6669b7ff74ba tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1689 microversion: 2.1 time: 0.162372 Jun 16 00:32:15.969782 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 288/587] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:15 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:32:16.988422 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-20fcc2c5-bfc3-434a-932b-2a2806749269 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:16.989498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-20fcc2c5-bfc3-434a-932b-2a2806749269 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:17.001478 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-20fcc2c5-bfc3-434a-932b-2a2806749269 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:17.001925 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-20fcc2c5-bfc3-434a-932b-2a2806749269 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:17.002697 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-20fcc2c5-bfc3-434a-932b-2a2806749269 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:17.003129 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-20fcc2c5-bfc3-434a-932b-2a2806749269 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:17.139288 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-20fcc2c5-bfc3-434a-932b-2a2806749269 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:17.147304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-20fcc2c5-bfc3-434a-932b-2a2806749269 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1689 microversion: 2.1 time: 0.165167 Jun 16 00:32:17.147893 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 300/588] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:16 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:17.928092 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-7cd84962-76c8-42c2-90f6-d9796c44fa43 req-d7cd1a44-4b40-4e88-9765-d5da1451f5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8298735b-2311-40d2-9261-ba64afe3b7fe", "name": "network-vif-deleted", "tag": "c5105353-b394-4e1d-81d1-b94b0637e747"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:32:17.932361 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:17.940168 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-7cd84962-76c8-42c2-90f6-d9796c44fa43 req-d7cd1a44-4b40-4e88-9765-d5da1451f5f0 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:17.940606 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-7cd84962-76c8-42c2-90f6-d9796c44fa43 req-d7cd1a44-4b40-4e88-9765-d5da1451f5f0 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:17.954488 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-7cd84962-76c8-42c2-90f6-d9796c44fa43 req-d7cd1a44-4b40-4e88-9765-d5da1451f5f0 service nova] Creating event network-vif-deleted:c5105353-b394-4e1d-81d1-b94b0637e747 for instance 8298735b-2311-40d2-9261-ba64afe3b7fe on hv-cinder-84599 Jun 16 00:32:17.960485 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-7cd84962-76c8-42c2-90f6-d9796c44fa43 req-d7cd1a44-4b40-4e88-9765-d5da1451f5f0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035972 Jun 16 00:32:17.961302 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 289/589] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:32:18.164107 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-39a73b89-c504-427f-9772-187ec11988de tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:18.164724 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-39a73b89-c504-427f-9772-187ec11988de tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:18.171266 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-39a73b89-c504-427f-9772-187ec11988de tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:18.171715 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-39a73b89-c504-427f-9772-187ec11988de tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:18.172509 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-39a73b89-c504-427f-9772-187ec11988de tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:18.172971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-39a73b89-c504-427f-9772-187ec11988de tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:18.205148 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-39a73b89-c504-427f-9772-187ec11988de tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:18.205604 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-39a73b89-c504-427f-9772-187ec11988de tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:18.206050 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.objects.instance [None req-39a73b89-c504-427f-9772-187ec11988de tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lazy-loading 'fault' on Instance uuid 8298735b-2311-40d2-9261-ba64afe3b7fe {{(pid=124231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:32:18.253543 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-39a73b89-c504-427f-9772-187ec11988de tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:18.261324 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-39a73b89-c504-427f-9772-187ec11988de tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 200 len: 1335 microversion: 2.1 time: 0.100959 Jun 16 00:32:18.261904 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 301/590] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:18 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 1335 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:19.359273 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b18731b3-06e2-4bfb-b312-27e3ad1ec3e8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:19.360017 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-b18731b3-06e2-4bfb-b312-27e3ad1ec3e8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: 8298735b-2311-40d2-9261-ba64afe3b7fe] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:19.366577 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b18731b3-06e2-4bfb-b312-27e3ad1ec3e8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:19.367023 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b18731b3-06e2-4bfb-b312-27e3ad1ec3e8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:19.367869 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b18731b3-06e2-4bfb-b312-27e3ad1ec3e8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:19.368253 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b18731b3-06e2-4bfb-b312-27e3ad1ec3e8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:19.387480 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-b18731b3-06e2-4bfb-b312-27e3ad1ec3e8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] HTTP exception thrown: Instance 8298735b-2311-40d2-9261-ba64afe3b7fe could not be found. Jun 16 00:32:19.389189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b18731b3-06e2-4bfb-b312-27e3ad1ec3e8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Request method failure captured: Jun 16 00:32:19.389189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe HTTP/1.1 Jun 16 00:32:19.389189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:32:19.389189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:32:19.389189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:32:19.389189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:32:19.389189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:32:19.389189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:32:19.389189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:32:19.389189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:32:19.389189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnjluY8jZVwwXlOxm5eGZoFzFsj2WHogoL70GrXk2XOxd5Vf-PQx2JzADNPun2hb_8YyL9atzw5OxHWiHsfPkN2e7HqJqwrKwxps6tY-O3e7u5qOSEIFwcLZmY6rGSskA_q37XGnDB6px_8ba9EsdtwksBNgGyqpqYD5fPwGkZ95O9E Jun 16 00:32:19.389189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:32:19.389189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:32:19.389189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:32:19.389189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:32:19.389189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:32:19.389189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:32:19.389189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: 0e5f17f8ba8e4113a27a004ebb29917a Jun 16 00:32:19.389189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1345783981 Jun 16 00:32:19.389189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:32:19.389189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:32:19.391281 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0e5f17f8ba8e4113a27a004ebb29917a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0e5f17f8ba8e4113a27a004ebb29917a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0e5f17f8ba8e4113a27a004ebb29917a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0e5f17f8ba8e4113a27a004ebb29917a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:32:19.391281 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1345783981 Jun 16 00:32:19.391281 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: 0e5f17f8ba8e4113a27a004ebb29917a Jun 16 00:32:19.391281 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1345783981 Jun 16 00:32:19.391281 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-ServerRescueNegativeTestJSON-1345783981-project Jun 16 00:32:19.391281 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:32:19.391281 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:32:19.391281 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: b5f4125ecaec41e5ba5c4eaf00c43e07 Jun 16 00:32:19.391281 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1345783981-project Jun 16 00:32:19.391281 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: > Jun 16 00:32:19.391281 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Instance 8298735b-2311-40d2-9261-ba64afe3b7fe could not be found. Jun 16 00:32:19.391281 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'id': '8298735b-2311-40d2-9261-ba64afe3b7fe'} Jun 16 00:32:19.392252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:32:19.392252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:19.392252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:32:19.392252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:32:19.392252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:32:19.392252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:32:19.392252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:32:19.392252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:32:19.392252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:32:19.392252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:32:19.392252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8298735b-2311-40d2-9261-ba64afe3b7fe could not be found. Jun 16 00:32:19.392252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:32:19.392252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:32:19.392252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:32:19.392252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:19.392252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:32:19.392252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:32:19.392252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:32:19.392252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:32:19.392252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:32:19.393502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:32:19.393502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:32:19.393502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:32:19.393502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:32:19.393502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:32:19.393502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:32:19.393502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:32:19.393502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8298735b-2311-40d2-9261-ba64afe3b7fe could not be found. Jun 16 00:32:19.393502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:32:19.393502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:32:19.393502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:32:19.393502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:19.393502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:32:19.393502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:32:19.393502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:32:19.393502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:32:19.393502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8298735b-2311-40d2-9261-ba64afe3b7fe could not be found. Jun 16 00:32:19.393502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:32:19.394855 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b18731b3-06e2-4bfb-b312-27e3ad1ec3e8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Returning 404 to user: Instance 8298735b-2311-40d2-9261-ba64afe3b7fe could not be found. {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:32:19.394855 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-b18731b3-06e2-4bfb-b312-27e3ad1ec3e8 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe" status: 404 len: 111 microversion: 2.1 time: 0.114753 Jun 16 00:32:19.394855 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 290/591] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:19 2022] GET /compute/v2.1/servers/8298735b-2311-40d2-9261-ba64afe3b7fe => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:32:19.400191 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-62d910e9-61c9-49e1-91c9-944ef5f8d9b3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '.version_select at 0x7fe704bb60d0>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:19.426841 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-62d910e9-61c9-49e1-91c9-944ef5f8d9b3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2020004617" status: 202 len: 0 microversion: 2.1 time: 0.029917 Jun 16 00:32:19.427850 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 302/592] 10.222.0.23 () {58 vars in 1220 bytes} [Thu Jun 16 00:32:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2020004617 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:32:22.286185 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-7177dad2-6e00-4f16-8faa-5e0a44c572aa tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:22.286676 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-7177dad2-6e00-4f16-8faa-5e0a44c572aa tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:22.293135 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7177dad2-6e00-4f16-8faa-5e0a44c572aa tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:22.293575 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7177dad2-6e00-4f16-8faa-5e0a44c572aa tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:22.294331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7177dad2-6e00-4f16-8faa-5e0a44c572aa tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:22.294761 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7177dad2-6e00-4f16-8faa-5e0a44c572aa tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:22.327373 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-7177dad2-6e00-4f16-8faa-5e0a44c572aa tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Going to try to terminate instance {{(pid=124230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:32:22.401453 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-7177dad2-6e00-4f16-8faa-5e0a44c572aa tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 204 len: 0 microversion: 2.1 time: 0.119795 Jun 16 00:32:22.402027 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 291/593] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:32:22 2022] DELETE /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:32:22.411601 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-42e56bc9-5804-4bc2-bbba-2815881dce9e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:22.412198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-42e56bc9-5804-4bc2-bbba-2815881dce9e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:22.418138 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-42e56bc9-5804-4bc2-bbba-2815881dce9e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:22.418829 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-42e56bc9-5804-4bc2-bbba-2815881dce9e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:22.419574 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-42e56bc9-5804-4bc2-bbba-2815881dce9e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:22.419998 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-42e56bc9-5804-4bc2-bbba-2815881dce9e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:22.550320 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-42e56bc9-5804-4bc2-bbba-2815881dce9e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:22.559798 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-42e56bc9-5804-4bc2-bbba-2815881dce9e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1508 microversion: 2.1 time: 0.152653 Jun 16 00:32:22.560383 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 303/594] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:22 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:23.578830 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-1508e82e-7547-480a-85d4-193663cf3ac3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:23.579520 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-1508e82e-7547-480a-85d4-193663cf3ac3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:23.585556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1508e82e-7547-480a-85d4-193663cf3ac3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:23.586001 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1508e82e-7547-480a-85d4-193663cf3ac3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:23.586754 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1508e82e-7547-480a-85d4-193663cf3ac3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:23.587182 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1508e82e-7547-480a-85d4-193663cf3ac3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:23.719312 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-1508e82e-7547-480a-85d4-193663cf3ac3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:23.726772 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-1508e82e-7547-480a-85d4-193663cf3ac3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1508 microversion: 2.1 time: 0.152328 Jun 16 00:32:23.727777 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 292/595] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:23 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:24.743517 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-13bbcea2-0131-4a7a-aba1-c91abf78569e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:24.744120 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-13bbcea2-0131-4a7a-aba1-c91abf78569e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:24.751391 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-13bbcea2-0131-4a7a-aba1-c91abf78569e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:24.751824 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-13bbcea2-0131-4a7a-aba1-c91abf78569e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:24.752567 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-13bbcea2-0131-4a7a-aba1-c91abf78569e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:24.753014 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-13bbcea2-0131-4a7a-aba1-c91abf78569e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:24.883823 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-13bbcea2-0131-4a7a-aba1-c91abf78569e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:24.891411 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-13bbcea2-0131-4a7a-aba1-c91abf78569e tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1508 microversion: 2.1 time: 0.151770 Jun 16 00:32:24.891981 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 304/596] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:24 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:25.429545 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-13308c61-938d-429b-aeae-ab9209213ac9 req-2725e176-c481-420f-95dd-a9aff49babd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d562dae7-709f-477a-b0bf-4aba72960541", "name": "network-vif-deleted", "tag": "fb317629-405c-4d69-af57-ef85adb84e2b"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:32:25.438835 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-13308c61-938d-429b-aeae-ab9209213ac9 req-2725e176-c481-420f-95dd-a9aff49babd4 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:25.439245 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-13308c61-938d-429b-aeae-ab9209213ac9 req-2725e176-c481-420f-95dd-a9aff49babd4 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:25.450944 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-13308c61-938d-429b-aeae-ab9209213ac9 req-2725e176-c481-420f-95dd-a9aff49babd4 service nova] Creating event network-vif-deleted:fb317629-405c-4d69-af57-ef85adb84e2b for instance d562dae7-709f-477a-b0bf-4aba72960541 on hv-cinder-84599 Jun 16 00:32:25.457048 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-13308c61-938d-429b-aeae-ab9209213ac9 req-2725e176-c481-420f-95dd-a9aff49babd4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030924 Jun 16 00:32:25.460511 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 293/597] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:32:25.907757 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-acf34845-a1d0-4735-a50d-e35fff6babe2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:25.908393 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-acf34845-a1d0-4735-a50d-e35fff6babe2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:25.915263 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-acf34845-a1d0-4735-a50d-e35fff6babe2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:25.915830 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-acf34845-a1d0-4735-a50d-e35fff6babe2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:25.916734 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-acf34845-a1d0-4735-a50d-e35fff6babe2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:25.917247 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-acf34845-a1d0-4735-a50d-e35fff6babe2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:25.950497 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-acf34845-a1d0-4735-a50d-e35fff6babe2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:25.950848 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-acf34845-a1d0-4735-a50d-e35fff6babe2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:25.951396 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.objects.instance [None req-acf34845-a1d0-4735-a50d-e35fff6babe2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lazy-loading 'fault' on Instance uuid d562dae7-709f-477a-b0bf-4aba72960541 {{(pid=124231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:32:25.993961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-acf34845-a1d0-4735-a50d-e35fff6babe2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:26.001900 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-acf34845-a1d0-4735-a50d-e35fff6babe2 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 200 len: 1312 microversion: 2.1 time: 0.098294 Jun 16 00:32:26.002465 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 305/598] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:25 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:27.020867 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-80f37373-7bd1-4a1a-ba2f-873b09f8d192 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:27.021493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-80f37373-7bd1-4a1a-ba2f-873b09f8d192 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: d562dae7-709f-477a-b0bf-4aba72960541] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:27.027611 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-80f37373-7bd1-4a1a-ba2f-873b09f8d192 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:27.028050 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-80f37373-7bd1-4a1a-ba2f-873b09f8d192 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:27.028794 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-80f37373-7bd1-4a1a-ba2f-873b09f8d192 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:27.029244 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-80f37373-7bd1-4a1a-ba2f-873b09f8d192 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:27.043024 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-80f37373-7bd1-4a1a-ba2f-873b09f8d192 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] HTTP exception thrown: Instance d562dae7-709f-477a-b0bf-4aba72960541 could not be found. Jun 16 00:32:27.044579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-80f37373-7bd1-4a1a-ba2f-873b09f8d192 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Request method failure captured: Jun 16 00:32:27.044579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 HTTP/1.1 Jun 16 00:32:27.044579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:32:27.044579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:32:27.044579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:32:27.044579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:32:27.044579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:32:27.044579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:32:27.044579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:32:27.044579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:32:27.044579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnjluY8jZVwwXlOxm5eGZoFzFsj2WHogoL70GrXk2XOxd5Vf-PQx2JzADNPun2hb_8YyL9atzw5OxHWiHsfPkN2e7HqJqwrKwxps6tY-O3e7u5qOSEIFwcLZmY6rGSskA_q37XGnDB6px_8ba9EsdtwksBNgGyqpqYD5fPwGkZ95O9E Jun 16 00:32:27.044579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:32:27.044579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:32:27.044579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:32:27.044579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:32:27.044579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:32:27.044579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:32:27.044579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: 0e5f17f8ba8e4113a27a004ebb29917a Jun 16 00:32:27.044579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1345783981 Jun 16 00:32:27.044579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:32:27.044579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:32:27.045885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0e5f17f8ba8e4113a27a004ebb29917a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0e5f17f8ba8e4113a27a004ebb29917a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0e5f17f8ba8e4113a27a004ebb29917a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0e5f17f8ba8e4113a27a004ebb29917a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:32:27.045885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1345783981 Jun 16 00:32:27.045885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: 0e5f17f8ba8e4113a27a004ebb29917a Jun 16 00:32:27.045885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1345783981 Jun 16 00:32:27.045885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-ServerRescueNegativeTestJSON-1345783981-project Jun 16 00:32:27.045885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:32:27.045885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:32:27.045885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: b5f4125ecaec41e5ba5c4eaf00c43e07 Jun 16 00:32:27.045885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1345783981-project Jun 16 00:32:27.045885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: > Jun 16 00:32:27.045885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Instance d562dae7-709f-477a-b0bf-4aba72960541 could not be found. Jun 16 00:32:27.045885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'id': 'd562dae7-709f-477a-b0bf-4aba72960541'} Jun 16 00:32:27.046613 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:32:27.046613 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:27.046613 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:32:27.046613 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:32:27.046613 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:32:27.046613 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:32:27.046613 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:32:27.046613 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:32:27.046613 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:32:27.046613 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:32:27.046613 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d562dae7-709f-477a-b0bf-4aba72960541 could not be found. Jun 16 00:32:27.046613 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:32:27.046613 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:32:27.046613 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:32:27.046613 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:27.046613 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:32:27.046613 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:32:27.046613 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:32:27.046613 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:32:27.046613 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:32:27.048125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:32:27.048125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:32:27.048125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:32:27.048125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:32:27.048125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:32:27.048125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:32:27.048125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:32:27.048125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d562dae7-709f-477a-b0bf-4aba72960541 could not be found. Jun 16 00:32:27.048125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:32:27.048125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:32:27.048125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:32:27.048125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:27.048125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:32:27.048125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:32:27.048125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:32:27.048125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:32:27.048125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d562dae7-709f-477a-b0bf-4aba72960541 could not be found. Jun 16 00:32:27.048125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:32:27.049373 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-80f37373-7bd1-4a1a-ba2f-873b09f8d192 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Returning 404 to user: Instance d562dae7-709f-477a-b0bf-4aba72960541 could not be found. {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:32:27.049373 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-80f37373-7bd1-4a1a-ba2f-873b09f8d192 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541" status: 404 len: 111 microversion: 2.1 time: 0.030982 Jun 16 00:32:27.049373 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 294/599] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:27 2022] GET /compute/v2.1/servers/d562dae7-709f-477a-b0bf-4aba72960541 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:32:27.054467 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-02f8893b-bca4-45a6-b519-d1c1aa06f4ee tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:27.054996 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-02f8893b-bca4-45a6-b519-d1c1aa06f4ee tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:27.061437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-02f8893b-bca4-45a6-b519-d1c1aa06f4ee tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:27.061884 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-02f8893b-bca4-45a6-b519-d1c1aa06f4ee tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:27.063366 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-02f8893b-bca4-45a6-b519-d1c1aa06f4ee tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:27.063799 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-02f8893b-bca4-45a6-b519-d1c1aa06f4ee tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:27.089213 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-02f8893b-bca4-45a6-b519-d1c1aa06f4ee tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Going to try to terminate instance {{(pid=124231) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:32:27.163394 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-02f8893b-bca4-45a6-b519-d1c1aa06f4ee tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 204 len: 0 microversion: 2.1 time: 0.112507 Jun 16 00:32:27.167168 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 306/600] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:32:27 2022] DELETE /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:32:27.173117 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-77cada48-99a0-439d-9a57-247f63546230 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:27.173729 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-77cada48-99a0-439d-9a57-247f63546230 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:27.179993 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-77cada48-99a0-439d-9a57-247f63546230 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:27.180433 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-77cada48-99a0-439d-9a57-247f63546230 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:27.181212 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-77cada48-99a0-439d-9a57-247f63546230 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:27.181640 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-77cada48-99a0-439d-9a57-247f63546230 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:27.311032 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-77cada48-99a0-439d-9a57-247f63546230 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:27.318964 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-77cada48-99a0-439d-9a57-247f63546230 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.150855 Jun 16 00:32:27.319523 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 295/601] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:27 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:28.337142 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-a51ad2b0-9439-4eb0-ba84-334590aa28e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:28.337835 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-a51ad2b0-9439-4eb0-ba84-334590aa28e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:28.345005 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a51ad2b0-9439-4eb0-ba84-334590aa28e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:28.345608 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a51ad2b0-9439-4eb0-ba84-334590aa28e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:28.347490 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a51ad2b0-9439-4eb0-ba84-334590aa28e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:28.347925 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a51ad2b0-9439-4eb0-ba84-334590aa28e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:28.476454 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-a51ad2b0-9439-4eb0-ba84-334590aa28e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:28.483871 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-a51ad2b0-9439-4eb0-ba84-334590aa28e3 tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.150924 Jun 16 00:32:28.484506 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 307/602] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:28 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:29.502173 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8533d021-3209-4689-8e6f-481b0eabef5d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:29.502766 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-8533d021-3209-4689-8e6f-481b0eabef5d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:29.509449 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8533d021-3209-4689-8e6f-481b0eabef5d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:29.509895 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8533d021-3209-4689-8e6f-481b0eabef5d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:29.510643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8533d021-3209-4689-8e6f-481b0eabef5d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:29.511072 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8533d021-3209-4689-8e6f-481b0eabef5d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:29.640011 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-8533d021-3209-4689-8e6f-481b0eabef5d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:29.648346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-8533d021-3209-4689-8e6f-481b0eabef5d tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.150972 Jun 16 00:32:29.649143 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 296/603] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:29 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:30.665511 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b1cdb942-aa58-4ccb-b3b7-166357ac665f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:30.666113 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-b1cdb942-aa58-4ccb-b3b7-166357ac665f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:30.674056 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b1cdb942-aa58-4ccb-b3b7-166357ac665f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:30.674500 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b1cdb942-aa58-4ccb-b3b7-166357ac665f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:30.675257 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b1cdb942-aa58-4ccb-b3b7-166357ac665f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:30.675691 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b1cdb942-aa58-4ccb-b3b7-166357ac665f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:30.808022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-b1cdb942-aa58-4ccb-b3b7-166357ac665f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f4125ecaec41e5ba5c4eaf00c43e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f17f8ba8e4113a27a004ebb29917a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:30.816954 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-b1cdb942-aa58-4ccb-b3b7-166357ac665f tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 200 len: 1521 microversion: 2.1 time: 0.155585 Jun 16 00:32:30.817527 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 308/604] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:30 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:31.305921 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-319630de-3c33-4412-ae75-56358a883909 req-a0a78406-d0ee-438b-ac80-1b994287919f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0", "name": "network-vif-deleted", "tag": "706dd94f-c3cb-40fa-a55b-a032e4c5f87b"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:32:31.316829 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-319630de-3c33-4412-ae75-56358a883909 req-a0a78406-d0ee-438b-ac80-1b994287919f service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:31.317288 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-319630de-3c33-4412-ae75-56358a883909 req-a0a78406-d0ee-438b-ac80-1b994287919f service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:31.328775 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-319630de-3c33-4412-ae75-56358a883909 req-a0a78406-d0ee-438b-ac80-1b994287919f service nova] Creating event network-vif-deleted:706dd94f-c3cb-40fa-a55b-a032e4c5f87b for instance c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 on hv-cinder-84599 Jun 16 00:32:31.333958 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-319630de-3c33-4412-ae75-56358a883909 req-a0a78406-d0ee-438b-ac80-1b994287919f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095918 Jun 16 00:32:31.334558 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 297/605] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:32:31.833949 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-fb06ccf5-3641-4690-b3b8-327f6465462c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:31.834551 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-fb06ccf5-3641-4690-b3b8-327f6465462c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] [instance: c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:31.841030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fb06ccf5-3641-4690-b3b8-327f6465462c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:31.841466 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fb06ccf5-3641-4690-b3b8-327f6465462c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:31.842208 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fb06ccf5-3641-4690-b3b8-327f6465462c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:31.842632 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fb06ccf5-3641-4690-b3b8-327f6465462c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:31.858020 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-fb06ccf5-3641-4690-b3b8-327f6465462c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] HTTP exception thrown: Instance c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 could not be found. Jun 16 00:32:31.859776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-fb06ccf5-3641-4690-b3b8-327f6465462c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Request method failure captured: Jun 16 00:32:31.859776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 HTTP/1.1 Jun 16 00:32:31.859776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:32:31.859776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:32:31.859776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:32:31.859776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:32:31.859776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:32:31.859776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:32:31.859776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:32:31.859776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:32:31.859776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnjluY8jZVwwXlOxm5eGZoFzFsj2WHogoL70GrXk2XOxd5Vf-PQx2JzADNPun2hb_8YyL9atzw5OxHWiHsfPkN2e7HqJqwrKwxps6tY-O3e7u5qOSEIFwcLZmY6rGSskA_q37XGnDB6px_8ba9EsdtwksBNgGyqpqYD5fPwGkZ95O9E Jun 16 00:32:31.859776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:32:31.859776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:32:31.859776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:32:31.859776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:32:31.859776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:32:31.859776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:32:31.859776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: 0e5f17f8ba8e4113a27a004ebb29917a Jun 16 00:32:31.859776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1345783981 Jun 16 00:32:31.859776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:32:31.859776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:32:31.861515 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0e5f17f8ba8e4113a27a004ebb29917a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0e5f17f8ba8e4113a27a004ebb29917a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0e5f17f8ba8e4113a27a004ebb29917a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0e5f17f8ba8e4113a27a004ebb29917a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:32:31.861515 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1345783981 Jun 16 00:32:31.861515 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: 0e5f17f8ba8e4113a27a004ebb29917a Jun 16 00:32:31.861515 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1345783981 Jun 16 00:32:31.861515 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-ServerRescueNegativeTestJSON-1345783981-project Jun 16 00:32:31.861515 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:32:31.861515 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:32:31.861515 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: b5f4125ecaec41e5ba5c4eaf00c43e07 Jun 16 00:32:31.861515 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1345783981-project Jun 16 00:32:31.861515 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:32:31.861515 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Instance c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 could not be found. Jun 16 00:32:31.861515 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': 'c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0'} Jun 16 00:32:31.862374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:32:31.862374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:31.862374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:32:31.862374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:32:31.862374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:32:31.862374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:32:31.862374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:32:31.862374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:32:31.862374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:32:31.862374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:32:31.862374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 could not be found. Jun 16 00:32:31.862374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:32:31.862374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:32:31.862374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:32:31.862374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:31.862374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:32:31.862374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:32:31.862374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:32:31.862374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:32:31.862374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:32:31.863817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:32:31.863817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:32:31.863817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:32:31.863817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:32:31.863817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:32:31.863817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:32:31.863817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:32:31.863817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 could not be found. Jun 16 00:32:31.863817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:32:31.863817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:32:31.863817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:32:31.863817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:31.863817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:32:31.863817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:32:31.863817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:32:31.863817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:32:31.863817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 could not be found. Jun 16 00:32:31.863817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:32:31.865216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-fb06ccf5-3641-4690-b3b8-327f6465462c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] Returning 404 to user: Instance c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:32:31.865216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-fb06ccf5-3641-4690-b3b8-327f6465462c tempest-ServerRescueNegativeTestJSON-1345783981 tempest-ServerRescueNegativeTestJSON-1345783981-project] 10.222.0.23 "GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0" status: 404 len: 111 microversion: 2.1 time: 0.031175 Jun 16 00:32:31.865216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 309/606] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:31 2022] GET /compute/v2.1/servers/c4b2225f-c3e1-4f8e-b08a-56c5e67a55d0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:32:39.707562 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-e525fe5e-d97c-46e2-bf1f-a3fb0e2c5539 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:39.709548 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-e525fe5e-d97c-46e2-bf1f-a3fb0e2c5539 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:39.717630 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e525fe5e-d97c-46e2-bf1f-a3fb0e2c5539 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:39.718134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e525fe5e-d97c-46e2-bf1f-a3fb0e2c5539 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:39.719239 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e525fe5e-d97c-46e2-bf1f-a3fb0e2c5539 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:39.719671 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e525fe5e-d97c-46e2-bf1f-a3fb0e2c5539 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:39.748195 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-e525fe5e-d97c-46e2-bf1f-a3fb0e2c5539 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d/ips" status: 200 len: 153 microversion: 2.20 time: 0.255709 Jun 16 00:32:39.748758 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 298/607] 10.222.0.23 () {60 vars in 1288 bytes} [Thu Jun 16 00:32:39 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d/ips => generated 153 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:32:40.487221 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-e4aceef3-57df-4a1e-a5cd-224009141463 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Action: 'create', calling method: .version_select at 0x7fe704b9db80>, body: {"keypair": {"name": "tempest-keypair-2081817421", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE4V07uN0PfgNrOqq+8Rb50mMlRE2KULZLiKp9AcK0ZVya+eFbzrqB/ut0q7x/aejBZPBNiTgdq+dt2zecOncLeEqTvxAL5qROwuhnN+/3Y6PNIp3KgH5C5/8UoKCeddw=="}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:32:40.502714 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-e4aceef3-57df-4a1e-a5cd-224009141463 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Getting quotas for project d2cc2e1e741d4eeb849e07d9f2c371be. Resources: {'key_pairs'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:32:40.506970 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-e4aceef3-57df-4a1e-a5cd-224009141463 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Getting quotas for user d5985474b0774d8ea0e62718de767310 and project d2cc2e1e741d4eeb849e07d9f2c371be. Resources: {'key_pairs'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:32:40.543737 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-e4aceef3-57df-4a1e-a5cd-224009141463 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.125005 Jun 16 00:32:40.543737 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 310/608] 10.222.0.23 () {60 vars in 1158 bytes} [Thu Jun 16 00:32:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:32:41.601335 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-1ad4f001-cb1f-4242-912d-d0fb4b08f570 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:32:41.601867 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-1ad4f001-cb1f-4242-912d-d0fb4b08f570 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:41.608815 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1ad4f001-cb1f-4242-912d-d0fb4b08f570 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:41.609780 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1ad4f001-cb1f-4242-912d-d0fb4b08f570 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:41.611357 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1ad4f001-cb1f-4242-912d-d0fb4b08f570 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:41.612347 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1ad4f001-cb1f-4242-912d-d0fb4b08f570 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:41.640838 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.objects.instance [None req-1ad4f001-cb1f-4242-912d-d0fb4b08f570 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lazy-loading 'flavor' on Instance uuid d86b6066-9081-4634-b4da-e5c5ddd72e9d {{(pid=124230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:32:41.953529 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-1ad4f001-cb1f-4242-912d-d0fb4b08f570 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "POST /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d/action" status: 202 len: 0 microversion: 2.20 time: 0.356205 Jun 16 00:32:41.954234 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 299/609] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Jun 16 00:32:41 2022] POST /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:32:41.962436 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-1c78d47e-93c5-4963-a4a8-22abda171f2e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:41.963908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-1c78d47e-93c5-4963-a4a8-22abda171f2e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:41.966734 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:41.972934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1c78d47e-93c5-4963-a4a8-22abda171f2e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:41.974251 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1c78d47e-93c5-4963-a4a8-22abda171f2e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:41.975157 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1c78d47e-93c5-4963-a4a8-22abda171f2e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:41.975707 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1c78d47e-93c5-4963-a4a8-22abda171f2e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:42.111847 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c6fa5f85-2cc8-4029-95eb-c893d9fc4d77 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-963110614", "imageRef": "d9a6de24-7a5e-4f8b-b078-809c87b15d56", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4c2828a-d371-4bf1-a496-04b5f8350696"}], "security_groups": [{"name": "tempest-securitygroup--406923258"}], "key_name": "tempest-keypair-2081817421", "user_data": "}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:32:42.135766 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-1c78d47e-93c5-4963-a4a8-22abda171f2e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:42.145764 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-1c78d47e-93c5-4963-a4a8-22abda171f2e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:42.147253 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-1c78d47e-93c5-4963-a4a8-22abda171f2e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:42.148544 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-1c78d47e-93c5-4963-a4a8-22abda171f2e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1725 microversion: 2.20 time: 0.190098 Jun 16 00:32:42.149314 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 311/610] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:32:41 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:32:42.220295 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.network.neutron [None req-c6fa5f85-2cc8-4029-95eb-c893d9fc4d77 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] validate_networks() for [('f4c2828a-d371-4bf1-a496-04b5f8350696', None, None, None, None, None)] {{(pid=124230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:32:42.675515 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-c6fa5f85-2cc8-4029-95eb-c893d9fc4d77 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Flavor limits 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:32:42.676145 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-c6fa5f85-2cc8-4029-95eb-c893d9fc4d77 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Image limits 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:32:42.676398 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-c6fa5f85-2cc8-4029-95eb-c893d9fc4d77 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Flavor pref 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:32:42.676805 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-c6fa5f85-2cc8-4029-95eb-c893d9fc4d77 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Image pref 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:32:42.677245 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-c6fa5f85-2cc8-4029-95eb-c893d9fc4d77 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:32:42.687586 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c6fa5f85-2cc8-4029-95eb-c893d9fc4d77 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:42.687977 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c6fa5f85-2cc8-4029-95eb-c893d9fc4d77 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:42.688812 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c6fa5f85-2cc8-4029-95eb-c893d9fc4d77 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:42.689273 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c6fa5f85-2cc8-4029-95eb-c893d9fc4d77 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:42.706582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-c6fa5f85-2cc8-4029-95eb-c893d9fc4d77 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Getting quotas for project d2cc2e1e741d4eeb849e07d9f2c371be. Resources: {'ram', 'cores', 'instances'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:32:42.710686 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-c6fa5f85-2cc8-4029-95eb-c893d9fc4d77 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Getting quotas for user d5985474b0774d8ea0e62718de767310 and project d2cc2e1e741d4eeb849e07d9f2c371be. Resources: {'ram', 'cores', 'instances'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:32:42.722265 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c6fa5f85-2cc8-4029-95eb-c893d9fc4d77 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Going to run 1 instances... {{(pid=124230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:32:42.724712 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c6fa5f85-2cc8-4029-95eb-c893d9fc4d77 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d9a6de24-7a5e-4f8b-b078-809c87b15d56',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:32:42.769500 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-f3c2db61-8a0a-4b22-990e-03de1cdb6b15 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:42.769915 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-f3c2db61-8a0a-4b22-990e-03de1cdb6b15 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:42.777323 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f3c2db61-8a0a-4b22-990e-03de1cdb6b15 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:42.777781 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f3c2db61-8a0a-4b22-990e-03de1cdb6b15 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:42.779212 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f3c2db61-8a0a-4b22-990e-03de1cdb6b15 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:42.779650 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f3c2db61-8a0a-4b22-990e-03de1cdb6b15 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:42.779864 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c6fa5f85-2cc8-4029-95eb-c893d9fc4d77 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.672531 Jun 16 00:32:42.780909 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 300/611] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Jun 16 00:32:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 00:32:42.791241 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8f373db1-b47f-4a26-981d-c577f36accdf tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:42.791951 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-8f373db1-b47f-4a26-981d-c577f36accdf tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:42.807723 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-f3c2db61-8a0a-4b22-990e-03de1cdb6b15 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230/ips" status: 200 len: 150 microversion: 2.1 time: 0.042406 Jun 16 00:32:42.808313 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 312/612] 10.222.0.23 () {58 vars in 1247 bytes} [Thu Jun 16 00:32:42 2022] GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:32:42.872859 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-8f373db1-b47f-4a26-981d-c577f36accdf tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:42.883033 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-8f373db1-b47f-4a26-981d-c577f36accdf tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1237 microversion: 2.1 time: 0.095436 Jun 16 00:32:42.883033 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 301/613] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:42 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1237 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:32:43.168163 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-38532576-f997-4f73-901a-713b1e8d9234 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:43.168846 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-38532576-f997-4f73-901a-713b1e8d9234 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:43.180014 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-38532576-f997-4f73-901a-713b1e8d9234 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:43.180604 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-38532576-f997-4f73-901a-713b1e8d9234 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:43.181330 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-38532576-f997-4f73-901a-713b1e8d9234 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:43.181811 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-38532576-f997-4f73-901a-713b1e8d9234 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:43.366828 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-38532576-f997-4f73-901a-713b1e8d9234 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:43.385801 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-38532576-f997-4f73-901a-713b1e8d9234 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:43.387774 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-38532576-f997-4f73-901a-713b1e8d9234 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:43.389274 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-38532576-f997-4f73-901a-713b1e8d9234 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1725 microversion: 2.20 time: 0.225473 Jun 16 00:32:43.390328 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 313/614] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:32:43 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:32:43.899361 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-f751d9c1-ac6a-49fb-9da5-91471dd43dcb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:43.899964 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-f751d9c1-ac6a-49fb-9da5-91471dd43dcb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:43.908206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f751d9c1-ac6a-49fb-9da5-91471dd43dcb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:43.908646 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f751d9c1-ac6a-49fb-9da5-91471dd43dcb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:43.909430 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f751d9c1-ac6a-49fb-9da5-91471dd43dcb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:43.910031 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f751d9c1-ac6a-49fb-9da5-91471dd43dcb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:43.912926 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:43.977322 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f751d9c1-ac6a-49fb-9da5-91471dd43dcb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:43.985408 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-f751d9c1-ac6a-49fb-9da5-91471dd43dcb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1289 microversion: 2.1 time: 0.089667 Jun 16 00:32:43.986234 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 302/615] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:43 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:44.186101 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-5de5049f-f183-4701-bec0-6d88bf10e370 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39389f1e-fbdf-4f35-b39c-93ac96dc0f07"}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:32:44.188681 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-5de5049f-f183-4701-bec0-6d88bf10e370 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:44.191520 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:44.197365 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5de5049f-f183-4701-bec0-6d88bf10e370 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:44.197896 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5de5049f-f183-4701-bec0-6d88bf10e370 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:44.198748 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5de5049f-f183-4701-bec0-6d88bf10e370 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:44.199397 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5de5049f-f183-4701-bec0-6d88bf10e370 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:44.409181 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-eeb73586-3cac-45ef-b7ad-4191e173c3cd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:44.410091 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-eeb73586-3cac-45ef-b7ad-4191e173c3cd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:44.417525 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-eeb73586-3cac-45ef-b7ad-4191e173c3cd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:44.417964 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-eeb73586-3cac-45ef-b7ad-4191e173c3cd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:44.432196 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-eeb73586-3cac-45ef-b7ad-4191e173c3cd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:44.433153 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-eeb73586-3cac-45ef-b7ad-4191e173c3cd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:44.643894 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-5de5049f-f183-4701-bec0-6d88bf10e370 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "POST /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.461700 Jun 16 00:32:44.661384 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 314/616] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Jun 16 00:32:44 2022] POST /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230/os-volume_attachments => generated 194 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:32:44.706878 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-eeb73586-3cac-45ef-b7ad-4191e173c3cd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:44.717888 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-eeb73586-3cac-45ef-b7ad-4191e173c3cd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:44.721603 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-eeb73586-3cac-45ef-b7ad-4191e173c3cd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:44.723085 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-eeb73586-3cac-45ef-b7ad-4191e173c3cd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1725 microversion: 2.20 time: 0.318864 Jun 16 00:32:44.724306 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 303/617] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:32:44 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1725 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:32:45.004280 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b1559afd-bcf4-4eee-8725-d806b89b67f3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:45.005033 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-b1559afd-bcf4-4eee-8725-d806b89b67f3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:45.011760 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b1559afd-bcf4-4eee-8725-d806b89b67f3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:45.012214 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b1559afd-bcf4-4eee-8725-d806b89b67f3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:45.013098 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b1559afd-bcf4-4eee-8725-d806b89b67f3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:45.013539 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b1559afd-bcf4-4eee-8725-d806b89b67f3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:45.087261 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-b1559afd-bcf4-4eee-8725-d806b89b67f3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:45.095714 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-b1559afd-bcf4-4eee-8725-d806b89b67f3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1295 microversion: 2.1 time: 0.096456 Jun 16 00:32:45.097257 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 315/618] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:44 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1295 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:45.741765 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-7d9ea67f-f044-4afa-8cd5-01cf56d73bea tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:45.742374 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-7d9ea67f-f044-4afa-8cd5-01cf56d73bea tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:45.749944 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7d9ea67f-f044-4afa-8cd5-01cf56d73bea tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:45.750401 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7d9ea67f-f044-4afa-8cd5-01cf56d73bea tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:45.751166 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7d9ea67f-f044-4afa-8cd5-01cf56d73bea tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:45.751784 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7d9ea67f-f044-4afa-8cd5-01cf56d73bea tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:45.976629 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-7d9ea67f-f044-4afa-8cd5-01cf56d73bea tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:45.986206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-7d9ea67f-f044-4afa-8cd5-01cf56d73bea tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:45.987715 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-7d9ea67f-f044-4afa-8cd5-01cf56d73bea tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:45.989081 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-7d9ea67f-f044-4afa-8cd5-01cf56d73bea tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1725 microversion: 2.20 time: 0.251374 Jun 16 00:32:45.989644 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 304/619] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:32:45 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:32:46.055209 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-5b069e04-0d06-45da-89ef-66a361426245 req-78344472-bb5a-460a-81d8-a78e84a68411 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fb9a660-6782-42cf-81df-8ac25aa4873d", "tag": "d246edbd-026a-4123-b145-fbc1e391af34"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:32:46.068022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-5b069e04-0d06-45da-89ef-66a361426245 req-78344472-bb5a-460a-81d8-a78e84a68411 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:46.068505 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-5b069e04-0d06-45da-89ef-66a361426245 req-78344472-bb5a-460a-81d8-a78e84a68411 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:46.082659 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-5b069e04-0d06-45da-89ef-66a361426245 req-78344472-bb5a-460a-81d8-a78e84a68411 service nova] Creating event network-changed:d246edbd-026a-4123-b145-fbc1e391af34 for instance 9fb9a660-6782-42cf-81df-8ac25aa4873d on hv-cinder-84599 Jun 16 00:32:46.087480 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-5b069e04-0d06-45da-89ef-66a361426245 req-78344472-bb5a-460a-81d8-a78e84a68411 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035965 Jun 16 00:32:46.088079 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 316/620] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:32:46.113889 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-15466e95-58b8-44e9-aaee-ebfee7f53645 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:46.114512 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-15466e95-58b8-44e9-aaee-ebfee7f53645 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:46.120785 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-15466e95-58b8-44e9-aaee-ebfee7f53645 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:46.121339 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-15466e95-58b8-44e9-aaee-ebfee7f53645 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:46.122307 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-15466e95-58b8-44e9-aaee-ebfee7f53645 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:46.122544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-15466e95-58b8-44e9-aaee-ebfee7f53645 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:46.356473 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-15466e95-58b8-44e9-aaee-ebfee7f53645 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:46.364739 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-15466e95-58b8-44e9-aaee-ebfee7f53645 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1362 microversion: 2.1 time: 0.254609 Jun 16 00:32:46.365337 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 305/621] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:46 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:47.007893 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-90a566e4-2cae-4e15-9258-e5f7ce73337b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:47.008517 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-90a566e4-2cae-4e15-9258-e5f7ce73337b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:47.014887 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-90a566e4-2cae-4e15-9258-e5f7ce73337b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:47.015333 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-90a566e4-2cae-4e15-9258-e5f7ce73337b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:47.016125 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-90a566e4-2cae-4e15-9258-e5f7ce73337b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:47.016551 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-90a566e4-2cae-4e15-9258-e5f7ce73337b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:47.146971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-90a566e4-2cae-4e15-9258-e5f7ce73337b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:47.154835 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-90a566e4-2cae-4e15-9258-e5f7ce73337b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:47.156323 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-90a566e4-2cae-4e15-9258-e5f7ce73337b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:47.157482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-90a566e4-2cae-4e15-9258-e5f7ce73337b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1725 microversion: 2.20 time: 0.154421 Jun 16 00:32:47.158063 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 317/622] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:32:47 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:32:47.381664 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-7de067f4-4672-4652-9e4f-dd53d244a5d9 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:47.382260 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-7de067f4-4672-4652-9e4f-dd53d244a5d9 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:47.388946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7de067f4-4672-4652-9e4f-dd53d244a5d9 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:47.389388 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7de067f4-4672-4652-9e4f-dd53d244a5d9 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:47.391018 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7de067f4-4672-4652-9e4f-dd53d244a5d9 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:47.391458 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7de067f4-4672-4652-9e4f-dd53d244a5d9 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:47.573370 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-7de067f4-4672-4652-9e4f-dd53d244a5d9 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:47.581562 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-7de067f4-4672-4652-9e4f-dd53d244a5d9 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1362 microversion: 2.1 time: 0.203696 Jun 16 00:32:47.582160 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 306/623] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:47 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:48.176422 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-e6348a3d-61bc-402b-8c2f-f2502935f3f1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:48.176953 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-e6348a3d-61bc-402b-8c2f-f2502935f3f1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:48.183414 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e6348a3d-61bc-402b-8c2f-f2502935f3f1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:48.183857 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e6348a3d-61bc-402b-8c2f-f2502935f3f1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:48.184607 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e6348a3d-61bc-402b-8c2f-f2502935f3f1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:48.185069 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e6348a3d-61bc-402b-8c2f-f2502935f3f1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:48.316626 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-e6348a3d-61bc-402b-8c2f-f2502935f3f1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:48.324523 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-e6348a3d-61bc-402b-8c2f-f2502935f3f1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:48.326035 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-e6348a3d-61bc-402b-8c2f-f2502935f3f1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:48.327175 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-e6348a3d-61bc-402b-8c2f-f2502935f3f1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1725 microversion: 2.20 time: 0.154707 Jun 16 00:32:48.328314 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 318/624] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:32:48 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:32:48.598821 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8006e39e-e4b8-4615-9cb0-efadbc886060 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:48.599430 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-8006e39e-e4b8-4615-9cb0-efadbc886060 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:48.606110 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8006e39e-e4b8-4615-9cb0-efadbc886060 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:48.606556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8006e39e-e4b8-4615-9cb0-efadbc886060 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:48.607310 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8006e39e-e4b8-4615-9cb0-efadbc886060 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:48.607743 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8006e39e-e4b8-4615-9cb0-efadbc886060 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:48.736100 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-8006e39e-e4b8-4615-9cb0-efadbc886060 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:48.743456 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-8006e39e-e4b8-4615-9cb0-efadbc886060 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1362 microversion: 2.1 time: 0.148468 Jun 16 00:32:48.744010 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 307/625] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:48 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:49.345641 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-1cb024bd-a8ad-4972-ac10-63eba11ea5d9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:49.346925 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-1cb024bd-a8ad-4972-ac10-63eba11ea5d9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:49.353408 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1cb024bd-a8ad-4972-ac10-63eba11ea5d9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:49.353897 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1cb024bd-a8ad-4972-ac10-63eba11ea5d9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:49.354617 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1cb024bd-a8ad-4972-ac10-63eba11ea5d9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:49.355049 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-1cb024bd-a8ad-4972-ac10-63eba11ea5d9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:49.488683 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-1cb024bd-a8ad-4972-ac10-63eba11ea5d9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:49.496727 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-1cb024bd-a8ad-4972-ac10-63eba11ea5d9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:49.498376 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-1cb024bd-a8ad-4972-ac10-63eba11ea5d9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:49.499734 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-1cb024bd-a8ad-4972-ac10-63eba11ea5d9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1725 microversion: 2.20 time: 0.157971 Jun 16 00:32:49.500290 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 319/626] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:32:49 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:32:49.759518 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-293b655c-d1ae-4285-83b3-4706057fa218 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:49.760124 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-293b655c-d1ae-4285-83b3-4706057fa218 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:49.762400 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:49.769207 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-293b655c-d1ae-4285-83b3-4706057fa218 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:49.769656 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-293b655c-d1ae-4285-83b3-4706057fa218 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:49.770400 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-293b655c-d1ae-4285-83b3-4706057fa218 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:49.770825 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-293b655c-d1ae-4285-83b3-4706057fa218 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:49.905816 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-293b655c-d1ae-4285-83b3-4706057fa218 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:49.913388 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-293b655c-d1ae-4285-83b3-4706057fa218 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1362 microversion: 2.1 time: 0.157649 Jun 16 00:32:49.913965 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 308/627] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:49 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:50.517851 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-2af3bf5f-1ee1-4cf0-afc5-852b60b0ba53 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:50.518639 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-2af3bf5f-1ee1-4cf0-afc5-852b60b0ba53 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:50.521097 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=4 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:50.526726 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2af3bf5f-1ee1-4cf0-afc5-852b60b0ba53 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:50.527169 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2af3bf5f-1ee1-4cf0-afc5-852b60b0ba53 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:50.527926 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2af3bf5f-1ee1-4cf0-afc5-852b60b0ba53 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:50.528357 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2af3bf5f-1ee1-4cf0-afc5-852b60b0ba53 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:50.663507 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-2af3bf5f-1ee1-4cf0-afc5-852b60b0ba53 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:50.672848 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-2af3bf5f-1ee1-4cf0-afc5-852b60b0ba53 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:50.674696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-2af3bf5f-1ee1-4cf0-afc5-852b60b0ba53 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:50.676018 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-2af3bf5f-1ee1-4cf0-afc5-852b60b0ba53 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1725 microversion: 2.20 time: 0.162367 Jun 16 00:32:50.676579 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 320/628] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:32:50 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:32:50.930674 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c33eb3ce-1dc3-478f-9ab3-68d39166b9ee tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:50.931282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c33eb3ce-1dc3-478f-9ab3-68d39166b9ee tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:50.937764 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c33eb3ce-1dc3-478f-9ab3-68d39166b9ee tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:50.938202 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c33eb3ce-1dc3-478f-9ab3-68d39166b9ee tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:50.939003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c33eb3ce-1dc3-478f-9ab3-68d39166b9ee tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:50.939450 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c33eb3ce-1dc3-478f-9ab3-68d39166b9ee tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:51.072069 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c33eb3ce-1dc3-478f-9ab3-68d39166b9ee tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:51.080540 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c33eb3ce-1dc3-478f-9ab3-68d39166b9ee tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1362 microversion: 2.1 time: 0.153407 Jun 16 00:32:51.081124 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 309/629] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:50 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:51.662297 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-9f15c29d-31bb-4cdd-a266-59aa23481e0c req-d909bf53-4dee-4963-93fb-178c4cfb0034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fb9a660-6782-42cf-81df-8ac25aa4873d", "name": "network-vif-plugged", "status": "completed", "tag": "d246edbd-026a-4123-b145-fbc1e391af34"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:32:51.670877 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-9f15c29d-31bb-4cdd-a266-59aa23481e0c req-d909bf53-4dee-4963-93fb-178c4cfb0034 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:51.671310 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-9f15c29d-31bb-4cdd-a266-59aa23481e0c req-d909bf53-4dee-4963-93fb-178c4cfb0034 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:51.682450 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-9f15c29d-31bb-4cdd-a266-59aa23481e0c req-d909bf53-4dee-4963-93fb-178c4cfb0034 service nova] Creating event network-vif-plugged:d246edbd-026a-4123-b145-fbc1e391af34 for instance 9fb9a660-6782-42cf-81df-8ac25aa4873d on hv-cinder-84599 Jun 16 00:32:51.689880 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-9f15c29d-31bb-4cdd-a266-59aa23481e0c req-d909bf53-4dee-4963-93fb-178c4cfb0034 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087241 Jun 16 00:32:51.693296 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 321/630] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:32:51.695552 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d213874e-b1c1-493a-9c27-f23836775831 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:51.696148 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d213874e-b1c1-493a-9c27-f23836775831 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:51.703377 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d213874e-b1c1-493a-9c27-f23836775831 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:51.703847 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d213874e-b1c1-493a-9c27-f23836775831 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:51.705274 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d213874e-b1c1-493a-9c27-f23836775831 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:51.705759 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d213874e-b1c1-493a-9c27-f23836775831 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:51.878487 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d213874e-b1c1-493a-9c27-f23836775831 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:51.886345 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d213874e-b1c1-493a-9c27-f23836775831 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:51.887828 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d213874e-b1c1-493a-9c27-f23836775831 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:51.888993 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d213874e-b1c1-493a-9c27-f23836775831 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1725 microversion: 2.20 time: 0.197831 Jun 16 00:32:51.889553 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 310/631] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:32:51 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:32:52.099423 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-a3d0e70c-ff6b-49d2-ac27-a79194fbcfae tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:52.100113 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-a3d0e70c-ff6b-49d2-ac27-a79194fbcfae tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:52.106304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a3d0e70c-ff6b-49d2-ac27-a79194fbcfae tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:52.106752 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a3d0e70c-ff6b-49d2-ac27-a79194fbcfae tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:52.107508 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a3d0e70c-ff6b-49d2-ac27-a79194fbcfae tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:52.107942 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a3d0e70c-ff6b-49d2-ac27-a79194fbcfae tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:52.187827 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b2bae27a-07a0-4d70-814d-58b62f9f954e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39389f1e-fbdf-4f35-b39c-93ac96dc0f07"}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:32:52.189030 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-b2bae27a-07a0-4d70-814d-58b62f9f954e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:52.195470 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b2bae27a-07a0-4d70-814d-58b62f9f954e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:52.195915 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b2bae27a-07a0-4d70-814d-58b62f9f954e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:52.196677 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b2bae27a-07a0-4d70-814d-58b62f9f954e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:52.197132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b2bae27a-07a0-4d70-814d-58b62f9f954e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:52.245931 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-a3d0e70c-ff6b-49d2-ac27-a79194fbcfae tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:52.253989 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-a3d0e70c-ff6b-49d2-ac27-a79194fbcfae tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1362 microversion: 2.1 time: 0.159313 Jun 16 00:32:52.254556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 322/632] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:52 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:52.275582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-b2bae27a-07a0-4d70-814d-58b62f9f954e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] HTTP exception thrown: Invalid volume: volume 39389f1e-fbdf-4f35-b39c-93ac96dc0f07 is already attached to instances: 01d77a9c-3658-4db2-ab07-b248d1c7a230 Jun 16 00:32:52.277346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b2bae27a-07a0-4d70-814d-58b62f9f954e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Request method failure captured: Jun 16 00:32:52.277346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: POST /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230/os-volume_attachments HTTP/1.1 Jun 16 00:32:52.277346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:32:52.277346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:32:52.277346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:32:52.277346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 74 Jun 16 00:32:52.277346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:32:52.277346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:32:52.277346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:32:52.277346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:32:52.277346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnlEQtlTYlcSb6Cxq7ka8JkFDrXY9ZTyYkOKl7RMv-Nc50AOOLvvYPcyo-002Bp2d50a3LSSgJspVILfxuCarFtF9OBY195yuIkdM0DVC_olTUnFngMBTQdDXeOL4IjwWYA5CoVYPq-YWQwNW1R5R2mbX6MVy2x9qf1Ysp-JTmbE9Gk Jun 16 00:32:52.277346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:32:52.277346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:32:52.277346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:32:52.277346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:32:52.277346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:32:52.277346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:32:52.277346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:32:52.277346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:32:52.277346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:32:52.277346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:32:52.278892 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:32:52.278892 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:32:52.278892 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:32:52.278892 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:32:52.278892 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:32:52.278892 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:32:52.278892 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:32:52.278892 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: 535a03ce19d346d59e6a6f6befb9dea0 Jun 16 00:32:52.278892 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:32:52.278892 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Jun 16 00:32:52.278892 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {"volumeAttachment": {"volumeId": "39389f1e-fbdf-4f35-b39c-93ac96dc0f07"}} Jun 16 00:32:52.278892 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: > Jun 16 00:32:52.279791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Invalid volume: volume 39389f1e-fbdf-4f35-b39c-93ac96dc0f07 is already attached to instances: 01d77a9c-3658-4db2-ab07-b248d1c7a230 Jun 16 00:32:52.279791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'server_id': '01d77a9c-3658-4db2-ab07-b248d1c7a230', 'body': {'volumeAttachment': {'volumeId': '39389f1e-fbdf-4f35-b39c-93ac96dc0f07'}}} Jun 16 00:32:52.279791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:32:52.279791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:52.279791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 00:32:52.279791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 00:32:52.279791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 00:32:52.279791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 00:32:52.279791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 00:32:52.279791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 00:32:52.279791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 00:32:52.279791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 00:32:52.279791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 00:32:52.279791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 00:32:52.279791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 39389f1e-fbdf-4f35-b39c-93ac96dc0f07 is already attached to instances: 01d77a9c-3658-4db2-ab07-b248d1c7a230 Jun 16 00:32:52.279791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:32:52.279791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:32:52.279791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:32:52.279791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:52.281206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:32:52.281206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:32:52.281206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:32:52.281206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:32:52.281206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:32:52.281206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:32:52.281206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:32:52.281206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:32:52.281206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:32:52.281206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:32:52.281206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:32:52.281206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:32:52.281206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 00:32:52.281206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 00:32:52.281206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 39389f1e-fbdf-4f35-b39c-93ac96dc0f07 is already attached to instances: 01d77a9c-3658-4db2-ab07-b248d1c7a230 Jun 16 00:32:52.281206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:32:52.281206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:32:52.281206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:32:52.281206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:52.281206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:32:52.283169 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:32:52.283169 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:32:52.283169 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:32:52.283169 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 39389f1e-fbdf-4f35-b39c-93ac96dc0f07 is already attached to instances: 01d77a9c-3658-4db2-ab07-b248d1c7a230 Jun 16 00:32:52.283169 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:32:52.283169 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b2bae27a-07a0-4d70-814d-58b62f9f954e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Returning 400 to user: Invalid volume: volume 39389f1e-fbdf-4f35-b39c-93ac96dc0f07 is already attached to instances: 01d77a9c-3658-4db2-ab07-b248d1c7a230 {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:32:52.283169 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-b2bae27a-07a0-4d70-814d-58b62f9f954e tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "POST /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094892 Jun 16 00:32:52.283169 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 311/633] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Jun 16 00:32:52 2022] POST /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 00:32:52.340136 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-86afd748-463e-42da-a58a-97a104ca957d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:52.340548 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-86afd748-463e-42da-a58a-97a104ca957d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:52.350678 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-86afd748-463e-42da-a58a-97a104ca957d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:52.351129 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-86afd748-463e-42da-a58a-97a104ca957d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:52.351897 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-86afd748-463e-42da-a58a-97a104ca957d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:52.352336 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-86afd748-463e-42da-a58a-97a104ca957d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:52.436960 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.objects.instance [None req-86afd748-463e-42da-a58a-97a104ca957d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lazy-loading 'services' on Instance uuid 01d77a9c-3658-4db2-ab07-b248d1c7a230 {{(pid=124231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:32:52.507022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-86afd748-463e-42da-a58a-97a104ca957d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "DELETE /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230/os-volume_attachments/39389f1e-fbdf-4f35-b39c-93ac96dc0f07" status: 202 len: 0 microversion: 2.1 time: 0.170726 Jun 16 00:32:52.507956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 323/634] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Jun 16 00:32:52 2022] DELETE /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230/os-volume_attachments/39389f1e-fbdf-4f35-b39c-93ac96dc0f07 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:32:52.517892 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-df1d91aa-5077-42b0-9688-37598f133ae6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:52.519163 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-df1d91aa-5077-42b0-9688-37598f133ae6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:52.526204 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-df1d91aa-5077-42b0-9688-37598f133ae6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:52.526645 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-df1d91aa-5077-42b0-9688-37598f133ae6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:52.527393 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-df1d91aa-5077-42b0-9688-37598f133ae6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:52.527820 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-df1d91aa-5077-42b0-9688-37598f133ae6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:52.557889 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-df1d91aa-5077-42b0-9688-37598f133ae6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044528 Jun 16 00:32:52.558432 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 312/635] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Jun 16 00:32:52 2022] GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:32:52.908717 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-29916d1f-ccd0-419d-bb84-1329b4a7463e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:52.909423 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-29916d1f-ccd0-419d-bb84-1329b4a7463e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:52.916129 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-29916d1f-ccd0-419d-bb84-1329b4a7463e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:52.916566 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-29916d1f-ccd0-419d-bb84-1329b4a7463e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:52.917343 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-29916d1f-ccd0-419d-bb84-1329b4a7463e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:52.917768 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-29916d1f-ccd0-419d-bb84-1329b4a7463e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:53.052906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-29916d1f-ccd0-419d-bb84-1329b4a7463e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:53.060924 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-29916d1f-ccd0-419d-bb84-1329b4a7463e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:53.062446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-29916d1f-ccd0-419d-bb84-1329b4a7463e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:53.064128 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-29916d1f-ccd0-419d-bb84-1329b4a7463e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1725 microversion: 2.20 time: 0.160342 Jun 16 00:32:53.064692 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 324/636] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:32:52 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:32:53.271718 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5c75e3bb-a75b-4308-92ab-176d274a2742 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:53.272270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-5c75e3bb-a75b-4308-92ab-176d274a2742 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:53.274261 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=2 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:53.274936 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=8 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:53.280948 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5c75e3bb-a75b-4308-92ab-176d274a2742 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:53.281398 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5c75e3bb-a75b-4308-92ab-176d274a2742 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:53.282276 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5c75e3bb-a75b-4308-92ab-176d274a2742 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:53.282925 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5c75e3bb-a75b-4308-92ab-176d274a2742 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:53.418436 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-5c75e3bb-a75b-4308-92ab-176d274a2742 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:53.426284 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-5c75e3bb-a75b-4308-92ab-176d274a2742 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1547 microversion: 2.1 time: 0.159657 Jun 16 00:32:53.426832 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 313/637] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:53 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:53.442859 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-bd56fab2-fb16-4982-8e69-1cc4cbac8c49 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:53.443351 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-bd56fab2-fb16-4982-8e69-1cc4cbac8c49 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:53.449404 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-bd56fab2-fb16-4982-8e69-1cc4cbac8c49 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:53.449853 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-bd56fab2-fb16-4982-8e69-1cc4cbac8c49 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:53.450606 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-bd56fab2-fb16-4982-8e69-1cc4cbac8c49 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:53.451036 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-bd56fab2-fb16-4982-8e69-1cc4cbac8c49 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:53.527298 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-bd56fab2-fb16-4982-8e69-1cc4cbac8c49 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088833 Jun 16 00:32:53.527917 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 325/638] 10.222.0.23 () {58 vars in 1274 bytes} [Thu Jun 16 00:32:53 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:32:53.570943 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d6504bed-ee94-47e9-a8d7-d09b90b62bbb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:53.571869 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d6504bed-ee94-47e9-a8d7-d09b90b62bbb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:53.578342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d6504bed-ee94-47e9-a8d7-d09b90b62bbb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:53.578824 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d6504bed-ee94-47e9-a8d7-d09b90b62bbb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:53.579632 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d6504bed-ee94-47e9-a8d7-d09b90b62bbb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:53.580116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d6504bed-ee94-47e9-a8d7-d09b90b62bbb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:53.611098 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d6504bed-ee94-47e9-a8d7-d09b90b62bbb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043098 Jun 16 00:32:53.611914 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 314/639] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Jun 16 00:32:53 2022] GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:32:54.083254 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-fc88440a-1057-4734-a309-e55ac6712008 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:54.083841 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-fc88440a-1057-4734-a309-e55ac6712008 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:54.090045 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fc88440a-1057-4734-a309-e55ac6712008 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:54.090497 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fc88440a-1057-4734-a309-e55ac6712008 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:54.091268 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fc88440a-1057-4734-a309-e55ac6712008 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:54.091703 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fc88440a-1057-4734-a309-e55ac6712008 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:54.340762 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-fc88440a-1057-4734-a309-e55ac6712008 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:54.349564 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-fc88440a-1057-4734-a309-e55ac6712008 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:54.351044 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-fc88440a-1057-4734-a309-e55ac6712008 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:54.352197 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-fc88440a-1057-4734-a309-e55ac6712008 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1725 microversion: 2.20 time: 0.273931 Jun 16 00:32:54.352958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 326/640] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:32:54 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1725 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:32:54.492777 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-440056ff-a67c-45f9-bb36-e7e7857f4e36 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-604041049"}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:32:54.493459 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-440056ff-a67c-45f9-bb36-e7e7857f4e36 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:54.499810 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-440056ff-a67c-45f9-bb36-e7e7857f4e36 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:54.500441 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-440056ff-a67c-45f9-bb36-e7e7857f4e36 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:54.501226 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-440056ff-a67c-45f9-bb36-e7e7857f4e36 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:54.501653 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-440056ff-a67c-45f9-bb36-e7e7857f4e36 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:54.590435 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-992f4f91-8a81-4805-8412-1e0e181fe40f req-30cab915-ad62-45df-bfe7-5efe10bad714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fb9a660-6782-42cf-81df-8ac25aa4873d", "tag": "d246edbd-026a-4123-b145-fbc1e391af34"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:32:54.599705 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-992f4f91-8a81-4805-8412-1e0e181fe40f req-30cab915-ad62-45df-bfe7-5efe10bad714 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:54.600144 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-992f4f91-8a81-4805-8412-1e0e181fe40f req-30cab915-ad62-45df-bfe7-5efe10bad714 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:54.612306 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-992f4f91-8a81-4805-8412-1e0e181fe40f req-30cab915-ad62-45df-bfe7-5efe10bad714 service nova] Creating event network-changed:d246edbd-026a-4123-b145-fbc1e391af34 for instance 9fb9a660-6782-42cf-81df-8ac25aa4873d on hv-cinder-84599 Jun 16 00:32:54.617244 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-992f4f91-8a81-4805-8412-1e0e181fe40f req-30cab915-ad62-45df-bfe7-5efe10bad714 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095813 Jun 16 00:32:54.618387 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 327/641] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:32:54.626970 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-deacab97-46b4-4f84-b063-07ded7225535 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:54.627534 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-deacab97-46b4-4f84-b063-07ded7225535 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:54.634241 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-deacab97-46b4-4f84-b063-07ded7225535 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:54.634680 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-deacab97-46b4-4f84-b063-07ded7225535 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:54.635436 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-deacab97-46b4-4f84-b063-07ded7225535 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:54.635860 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-deacab97-46b4-4f84-b063-07ded7225535 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:54.639818 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:54.669987 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-deacab97-46b4-4f84-b063-07ded7225535 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047590 Jun 16 00:32:54.671120 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 328/642] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Jun 16 00:32:54 2022] GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:32:54.689033 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.network.security_group_api [None req-440056ff-a67c-45f9-bb36-e7e7857f4e36 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Removing security group 32dd3680-8cdd-46b9-b9cf-70343fb40770 from port cff9c087-7e00-4554-b1a9-538c7504d332 Jun 16 00:32:54.741324 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-59f9ea9d-7f3e-46cb-8eb4-d3bc9fef90c1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:54.741939 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-59f9ea9d-7f3e-46cb-8eb4-d3bc9fef90c1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:54.748084 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59f9ea9d-7f3e-46cb-8eb4-d3bc9fef90c1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:54.748602 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59f9ea9d-7f3e-46cb-8eb4-d3bc9fef90c1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:54.749454 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59f9ea9d-7f3e-46cb-8eb4-d3bc9fef90c1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:54.749947 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59f9ea9d-7f3e-46cb-8eb4-d3bc9fef90c1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:54.778177 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-59f9ea9d-7f3e-46cb-8eb4-d3bc9fef90c1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Going to try to terminate instance {{(pid=124231) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:32:54.872332 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-59f9ea9d-7f3e-46cb-8eb4-d3bc9fef90c1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "DELETE /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230" status: 204 len: 0 microversion: 2.1 time: 0.134293 Jun 16 00:32:54.876066 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 329/643] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:32:54 2022] DELETE /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:32:54.884291 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b5c44e03-54e9-4baf-8b35-242b37a8d1d9 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:54.885010 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-b5c44e03-54e9-4baf-8b35-242b37a8d1d9 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:54.892017 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b5c44e03-54e9-4baf-8b35-242b37a8d1d9 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:54.892449 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b5c44e03-54e9-4baf-8b35-242b37a8d1d9 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:54.893499 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b5c44e03-54e9-4baf-8b35-242b37a8d1d9 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:54.893922 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b5c44e03-54e9-4baf-8b35-242b37a8d1d9 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:55.039004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-b5c44e03-54e9-4baf-8b35-242b37a8d1d9 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:55.046530 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-b5c44e03-54e9-4baf-8b35-242b37a8d1d9 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230" status: 200 len: 1680 microversion: 2.1 time: 0.168615 Jun 16 00:32:55.047315 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 330/644] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:54 2022] GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:32:55.139986 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-440056ff-a67c-45f9-bb36-e7e7857f4e36 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "POST /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c/action" status: 202 len: 0 microversion: 2.1 time: 0.649890 Jun 16 00:32:55.140965 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 315/645] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Jun 16 00:32:54 2022] POST /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c/action => generated 0 bytes in 654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 00:32:55.153811 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-c7c2ffdd-948b-45e5-b289-ec059c719329 req-60e98fad-f44e-42b9-9919-1c8e20c17c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0750226-e65f-4cfc-94df-46f38bbd623c", "tag": "cff9c087-7e00-4554-b1a9-538c7504d332"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:32:55.170711 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-c7c2ffdd-948b-45e5-b289-ec059c719329 req-60e98fad-f44e-42b9-9919-1c8e20c17c82 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:55.171158 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-c7c2ffdd-948b-45e5-b289-ec059c719329 req-60e98fad-f44e-42b9-9919-1c8e20c17c82 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:55.201035 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-c7c2ffdd-948b-45e5-b289-ec059c719329 req-60e98fad-f44e-42b9-9919-1c8e20c17c82 service nova] Creating event network-changed:cff9c087-7e00-4554-b1a9-538c7504d332 for instance c0750226-e65f-4cfc-94df-46f38bbd623c on hv-cinder-84599 Jun 16 00:32:55.208555 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-c7c2ffdd-948b-45e5-b289-ec059c719329 req-60e98fad-f44e-42b9-9919-1c8e20c17c82 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059742 Jun 16 00:32:55.209529 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 331/646] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:32:55.377685 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-af7c49bd-330b-44ca-a9e1-6f6222495ef9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:55.379134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-af7c49bd-330b-44ca-a9e1-6f6222495ef9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:55.387148 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-af7c49bd-330b-44ca-a9e1-6f6222495ef9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:55.387838 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-af7c49bd-330b-44ca-a9e1-6f6222495ef9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:55.388950 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-af7c49bd-330b-44ca-a9e1-6f6222495ef9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:55.389529 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-af7c49bd-330b-44ca-a9e1-6f6222495ef9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:55.626372 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-af7c49bd-330b-44ca-a9e1-6f6222495ef9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:55.644796 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-af7c49bd-330b-44ca-a9e1-6f6222495ef9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:55.646258 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-af7c49bd-330b-44ca-a9e1-6f6222495ef9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:55.647616 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-af7c49bd-330b-44ca-a9e1-6f6222495ef9 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1725 microversion: 2.20 time: 0.280665 Jun 16 00:32:55.648527 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 316/647] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:32:55 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1725 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:32:56.065154 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-67df9470-d252-4bd8-a10d-63ca1bb7d351 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:56.065858 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-67df9470-d252-4bd8-a10d-63ca1bb7d351 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:56.072122 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-67df9470-d252-4bd8-a10d-63ca1bb7d351 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:56.072563 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-67df9470-d252-4bd8-a10d-63ca1bb7d351 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:56.073349 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-67df9470-d252-4bd8-a10d-63ca1bb7d351 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:56.073814 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-67df9470-d252-4bd8-a10d-63ca1bb7d351 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:56.208322 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-67df9470-d252-4bd8-a10d-63ca1bb7d351 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:56.215878 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-67df9470-d252-4bd8-a10d-63ca1bb7d351 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230" status: 200 len: 1680 microversion: 2.1 time: 0.155635 Jun 16 00:32:56.216439 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 332/648] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:56 2022] GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:56.398741 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-17b41514-bed5-4c9a-83b6-da83ab93f265 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:56.399292 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-17b41514-bed5-4c9a-83b6-da83ab93f265 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:56.405394 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-17b41514-bed5-4c9a-83b6-da83ab93f265 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:56.405847 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-17b41514-bed5-4c9a-83b6-da83ab93f265 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:56.406738 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-17b41514-bed5-4c9a-83b6-da83ab93f265 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:56.407260 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-17b41514-bed5-4c9a-83b6-da83ab93f265 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:56.544262 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.objects.instance [None req-17b41514-bed5-4c9a-83b6-da83ab93f265 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lazy-loading 'services' on Instance uuid c0750226-e65f-4cfc-94df-46f38bbd623c {{(pid=124230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:32:56.666166 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-468a8e96-50f5-4c78-b861-dcbcda7715d0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:56.667035 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-468a8e96-50f5-4c78-b861-dcbcda7715d0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:56.676997 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-468a8e96-50f5-4c78-b861-dcbcda7715d0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:56.677446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-468a8e96-50f5-4c78-b861-dcbcda7715d0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:56.678363 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-468a8e96-50f5-4c78-b861-dcbcda7715d0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:56.678752 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-468a8e96-50f5-4c78-b861-dcbcda7715d0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:56.724680 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-17b41514-bed5-4c9a-83b6-da83ab93f265 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c/os-volume_attachments/5f209b2e-aa4b-4058-8017-5d20570333a5" status: 202 len: 0 microversion: 2.1 time: 0.330015 Jun 16 00:32:56.726123 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 317/649] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Jun 16 00:32:56 2022] DELETE /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c/os-volume_attachments/5f209b2e-aa4b-4058-8017-5d20570333a5 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:32:56.748857 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-57389460-274d-4a1e-b7fe-c0762c2b24a0 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:56.752279 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-57389460-274d-4a1e-b7fe-c0762c2b24a0 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:56.775825 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-57389460-274d-4a1e-b7fe-c0762c2b24a0 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:56.778055 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-57389460-274d-4a1e-b7fe-c0762c2b24a0 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:56.779464 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-57389460-274d-4a1e-b7fe-c0762c2b24a0 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:56.780175 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-57389460-274d-4a1e-b7fe-c0762c2b24a0 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:56.822934 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:56.841809 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-57389460-274d-4a1e-b7fe-c0762c2b24a0 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107708 Jun 16 00:32:56.842684 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 318/650] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Jun 16 00:32:56 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:32:57.023711 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-468a8e96-50f5-4c78-b861-dcbcda7715d0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:57.033161 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-468a8e96-50f5-4c78-b861-dcbcda7715d0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:57.034407 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-468a8e96-50f5-4c78-b861-dcbcda7715d0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:57.035573 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-468a8e96-50f5-4c78-b861-dcbcda7715d0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1725 microversion: 2.20 time: 0.373766 Jun 16 00:32:57.036319 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 333/651] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:32:56 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1725 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:32:57.233188 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c4f876e1-aec7-486f-9732-ddd37774c4b3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:57.233810 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c4f876e1-aec7-486f-9732-ddd37774c4b3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:57.241387 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c4f876e1-aec7-486f-9732-ddd37774c4b3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:57.241992 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c4f876e1-aec7-486f-9732-ddd37774c4b3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:57.242580 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c4f876e1-aec7-486f-9732-ddd37774c4b3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:57.243337 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c4f876e1-aec7-486f-9732-ddd37774c4b3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:57.268370 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-d222bba2-7925-4982-b5bb-74e12d3c30dd req-0fbe033e-96b3-4b53-8e34-3a6042773648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0750226-e65f-4cfc-94df-46f38bbd623c", "tag": "cff9c087-7e00-4554-b1a9-538c7504d332"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:32:57.281435 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-d222bba2-7925-4982-b5bb-74e12d3c30dd req-0fbe033e-96b3-4b53-8e34-3a6042773648 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:57.282120 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-d222bba2-7925-4982-b5bb-74e12d3c30dd req-0fbe033e-96b3-4b53-8e34-3a6042773648 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:57.295211 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-d222bba2-7925-4982-b5bb-74e12d3c30dd req-0fbe033e-96b3-4b53-8e34-3a6042773648 service nova] Creating event network-changed:cff9c087-7e00-4554-b1a9-538c7504d332 for instance c0750226-e65f-4cfc-94df-46f38bbd623c on hv-cinder-84599 Jun 16 00:32:57.301515 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-d222bba2-7925-4982-b5bb-74e12d3c30dd req-0fbe033e-96b3-4b53-8e34-3a6042773648 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037163 Jun 16 00:32:57.302350 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 334/652] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:32:57.491315 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c4f876e1-aec7-486f-9732-ddd37774c4b3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:57.500272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c4f876e1-aec7-486f-9732-ddd37774c4b3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230" status: 200 len: 1680 microversion: 2.1 time: 0.271008 Jun 16 00:32:57.511258 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 319/653] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:57 2022] GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230 => generated 1680 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:57.857583 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-7f00638a-b768-40fc-8ff2-2e5bb6f268c9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:57.858846 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-7f00638a-b768-40fc-8ff2-2e5bb6f268c9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:57.869386 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7f00638a-b768-40fc-8ff2-2e5bb6f268c9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:57.870117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7f00638a-b768-40fc-8ff2-2e5bb6f268c9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:57.870893 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7f00638a-b768-40fc-8ff2-2e5bb6f268c9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:57.871324 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7f00638a-b768-40fc-8ff2-2e5bb6f268c9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:57.910552 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-7f00638a-b768-40fc-8ff2-2e5bb6f268c9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058254 Jun 16 00:32:57.916176 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 335/654] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Jun 16 00:32:57 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:32:57.921528 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8c6f7837-cda4-446e-b770-24afe074d14d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:57.922032 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-8c6f7837-cda4-446e-b770-24afe074d14d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:57.929423 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8c6f7837-cda4-446e-b770-24afe074d14d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:57.930106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8c6f7837-cda4-446e-b770-24afe074d14d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:57.931064 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8c6f7837-cda4-446e-b770-24afe074d14d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:57.931660 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8c6f7837-cda4-446e-b770-24afe074d14d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:58.045300 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-8c6f7837-cda4-446e-b770-24afe074d14d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] HTTP exception thrown: Instance c0750226-e65f-4cfc-94df-46f38bbd623c is not attached to volume 5f209b2e-aa4b-4058-8017-5d20570333a5 Jun 16 00:32:58.051983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8c6f7837-cda4-446e-b770-24afe074d14d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Request method failure captured: Jun 16 00:32:58.051983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: DELETE /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c/os-volume_attachments/5f209b2e-aa4b-4058-8017-5d20570333a5 HTTP/1.1 Jun 16 00:32:58.051983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:32:58.051983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:32:58.051983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:32:58.051983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:32:58.051983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:32:58.051983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:32:58.051983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:32:58.051983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:32:58.051983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnmedLy6MiXOttFAXYWZCu_4JXPN4hU9MCOA3wycrOyNUlUDgPA2C6Jf3ECTnUVClOdGz9cqUUAX4jaupu0OqdMEw71FBXThe_kx9ro2EVrSjdldd1NUlG5j5E-nF7qnzl94lLLSRm1hUEVDsf99DfK2bd4uFjaLv8Ip8VYW-wimGaA Jun 16 00:32:58.051983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:32:58.051983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:32:58.051983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:32:58.051983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:32:58.051983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:32:58.051983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:32:58.051983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: 87ac732ab7df406c933081dd4939ae1e Jun 16 00:32:58.051983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-TestMinimumBasicScenario-63549410 Jun 16 00:32:58.051983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:32:58.051983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:32:58.053695 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_87ac732ab7df406c933081dd4939ae1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/87ac732ab7df406c933081dd4939ae1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/87ac732ab7df406c933081dd4939ae1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/87ac732ab7df406c933081dd4939ae1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:32:58.053695 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-TestMinimumBasicScenario-63549410 Jun 16 00:32:58.053695 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: 87ac732ab7df406c933081dd4939ae1e Jun 16 00:32:58.053695 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-TestMinimumBasicScenario-63549410 Jun 16 00:32:58.053695 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-TestMinimumBasicScenario-63549410-project Jun 16 00:32:58.053695 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:32:58.053695 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:32:58.053695 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: a5d4beaae81b4b8b9e4057f012d18b8b Jun 16 00:32:58.053695 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-TestMinimumBasicScenario-63549410-project Jun 16 00:32:58.053695 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: > Jun 16 00:32:58.053695 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Instance c0750226-e65f-4cfc-94df-46f38bbd623c is not attached to volume 5f209b2e-aa4b-4058-8017-5d20570333a5 Jun 16 00:32:58.054533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'server_id': 'c0750226-e65f-4cfc-94df-46f38bbd623c', 'id': '5f209b2e-aa4b-4058-8017-5d20570333a5'} Jun 16 00:32:58.054533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:32:58.054533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:58.054533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 16 00:32:58.054533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 16 00:32:58.054533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 00:32:58.054533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 00:32:58.054533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 16 00:32:58.054533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 16 00:32:58.054533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5f209b2e-aa4b-4058-8017-5d20570333a5. Jun 16 00:32:58.054533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:32:58.054533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:32:58.054533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:32:58.054533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:58.054533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:32:58.054533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:32:58.054533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:32:58.054533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:32:58.054533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:32:58.055952 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:32:58.055952 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 16 00:32:58.055952 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 00:32:58.055952 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0750226-e65f-4cfc-94df-46f38bbd623c is not attached to volume 5f209b2e-aa4b-4058-8017-5d20570333a5 Jun 16 00:32:58.055952 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:32:58.055952 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:32:58.055952 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:32:58.055952 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:58.055952 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:32:58.055952 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:32:58.055952 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:32:58.055952 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:32:58.055952 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0750226-e65f-4cfc-94df-46f38bbd623c is not attached to volume 5f209b2e-aa4b-4058-8017-5d20570333a5 Jun 16 00:32:58.055952 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:32:58.056945 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-ed4b5884-2532-4b3a-a2bc-a151003cefa5 req-84072901-cfde-4bb0-b5bd-bd88fd4ed38e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01d77a9c-3658-4db2-ab07-b248d1c7a230", "name": "network-vif-deleted", "tag": "40cf5e59-5b43-4cfc-b0ac-9b7bcf0e5df3"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:32:58.057821 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8c6f7837-cda4-446e-b770-24afe074d14d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Returning 404 to user: Instance c0750226-e65f-4cfc-94df-46f38bbd623c is not attached to volume 5f209b2e-aa4b-4058-8017-5d20570333a5 {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:32:58.058972 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-8c6f7837-cda4-446e-b770-24afe074d14d tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c/os-volume_attachments/5f209b2e-aa4b-4058-8017-5d20570333a5" status: 404 len: 154 microversion: 2.1 time: 0.141463 Jun 16 00:32:58.060694 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 320/655] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Jun 16 00:32:57 2022] DELETE /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c/os-volume_attachments/5f209b2e-aa4b-4058-8017-5d20570333a5 => generated 154 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:32:58.066531 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-0bcbbb28-105d-4b56-af3f-a1eceb4da42f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:58.067151 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-0bcbbb28-105d-4b56-af3f-a1eceb4da42f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:58.074500 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-ed4b5884-2532-4b3a-a2bc-a151003cefa5 req-84072901-cfde-4bb0-b5bd-bd88fd4ed38e service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:58.079939 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0bcbbb28-105d-4b56-af3f-a1eceb4da42f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:58.080447 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0bcbbb28-105d-4b56-af3f-a1eceb4da42f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:58.081523 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-ed4b5884-2532-4b3a-a2bc-a151003cefa5 req-84072901-cfde-4bb0-b5bd-bd88fd4ed38e service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:58.086171 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0bcbbb28-105d-4b56-af3f-a1eceb4da42f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:58.086850 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0bcbbb28-105d-4b56-af3f-a1eceb4da42f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:58.104923 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-ed4b5884-2532-4b3a-a2bc-a151003cefa5 req-84072901-cfde-4bb0-b5bd-bd88fd4ed38e service nova] Creating event network-vif-deleted:40cf5e59-5b43-4cfc-b0ac-9b7bcf0e5df3 for instance 01d77a9c-3658-4db2-ab07-b248d1c7a230 on hv-cinder-84599 Jun 16 00:32:58.111206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-ed4b5884-2532-4b3a-a2bc-a151003cefa5 req-84072901-cfde-4bb0-b5bd-bd88fd4ed38e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060584 Jun 16 00:32:58.112914 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 336/656] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:32:58.361761 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0bcbbb28-105d-4b56-af3f-a1eceb4da42f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:58.372141 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0bcbbb28-105d-4b56-af3f-a1eceb4da42f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:58.374009 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0bcbbb28-105d-4b56-af3f-a1eceb4da42f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:58.375598 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-0bcbbb28-105d-4b56-af3f-a1eceb4da42f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1746 microversion: 2.20 time: 0.313315 Jun 16 00:32:58.376471 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 321/657] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:32:58 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1746 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:32:58.520261 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d5884816-4e4d-4d44-89bd-077275713394 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:58.521275 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-d5884816-4e4d-4d44-89bd-077275713394 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:58.540934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d5884816-4e4d-4d44-89bd-077275713394 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:58.541385 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d5884816-4e4d-4d44-89bd-077275713394 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:58.542160 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d5884816-4e4d-4d44-89bd-077275713394 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:58.542590 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d5884816-4e4d-4d44-89bd-077275713394 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:58.577878 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d5884816-4e4d-4d44-89bd-077275713394 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:58.579068 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d5884816-4e4d-4d44-89bd-077275713394 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:58.579680 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.objects.instance [None req-d5884816-4e4d-4d44-89bd-077275713394 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lazy-loading 'fault' on Instance uuid 01d77a9c-3658-4db2-ab07-b248d1c7a230 {{(pid=124231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:32:58.630290 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d5884816-4e4d-4d44-89bd-077275713394 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:58.638752 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-d5884816-4e4d-4d44-89bd-077275713394 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230" status: 200 len: 1330 microversion: 2.1 time: 0.124444 Jun 16 00:32:58.639314 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 337/658] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:58 2022] GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230 => generated 1330 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:59.237281 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-fcf985f4-594f-45f8-99fe-3dc56fb80d67 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:59.237770 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-fcf985f4-594f-45f8-99fe-3dc56fb80d67 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:59.244130 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fcf985f4-594f-45f8-99fe-3dc56fb80d67 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:59.244571 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fcf985f4-594f-45f8-99fe-3dc56fb80d67 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:59.245341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fcf985f4-594f-45f8-99fe-3dc56fb80d67 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:59.245769 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fcf985f4-594f-45f8-99fe-3dc56fb80d67 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:59.273475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-fcf985f4-594f-45f8-99fe-3dc56fb80d67 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Going to try to terminate instance {{(pid=124230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:32:59.346297 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-fcf985f4-594f-45f8-99fe-3dc56fb80d67 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 204 len: 0 microversion: 2.1 time: 0.113278 Jun 16 00:32:59.346810 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 322/659] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:32:59 2022] DELETE /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:32:59.359668 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-043c5d27-41b0-4559-ad65-a2b7d6689fdb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:59.360249 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-043c5d27-41b0-4559-ad65-a2b7d6689fdb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:59.366985 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-043c5d27-41b0-4559-ad65-a2b7d6689fdb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:59.367426 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-043c5d27-41b0-4559-ad65-a2b7d6689fdb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:59.368187 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-043c5d27-41b0-4559-ad65-a2b7d6689fdb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:59.368615 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-043c5d27-41b0-4559-ad65-a2b7d6689fdb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:59.398124 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8bc688f4-7f31-4985-a5ad-4c3d56466b70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:59.399204 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-8bc688f4-7f31-4985-a5ad-4c3d56466b70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:59.405369 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8bc688f4-7f31-4985-a5ad-4c3d56466b70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:59.405827 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8bc688f4-7f31-4985-a5ad-4c3d56466b70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:59.406724 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8bc688f4-7f31-4985-a5ad-4c3d56466b70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:59.407652 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8bc688f4-7f31-4985-a5ad-4c3d56466b70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:59.516544 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-043c5d27-41b0-4559-ad65-a2b7d6689fdb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:59.525228 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-043c5d27-41b0-4559-ad65-a2b7d6689fdb tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1554 microversion: 2.1 time: 0.169417 Jun 16 00:32:59.525880 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 338/660] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:59 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:59.555387 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-8bc688f4-7f31-4985-a5ad-4c3d56466b70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:59.563512 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-8bc688f4-7f31-4985-a5ad-4c3d56466b70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:59.565062 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-8bc688f4-7f31-4985-a5ad-4c3d56466b70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:59.566221 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-8bc688f4-7f31-4985-a5ad-4c3d56466b70 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1746 microversion: 2.20 time: 0.173838 Jun 16 00:32:59.566778 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 323/661] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:32:59 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1746 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:32:59.656061 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d874be0f-4543-4793-b6e4-5f1e43297035 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:59.657906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-d874be0f-4543-4793-b6e4-5f1e43297035 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:59.663933 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d874be0f-4543-4793-b6e4-5f1e43297035 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:59.664376 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d874be0f-4543-4793-b6e4-5f1e43297035 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:59.665164 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d874be0f-4543-4793-b6e4-5f1e43297035 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:59.665597 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d874be0f-4543-4793-b6e4-5f1e43297035 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:59.679471 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-d874be0f-4543-4793-b6e4-5f1e43297035 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] HTTP exception thrown: Instance 01d77a9c-3658-4db2-ab07-b248d1c7a230 could not be found. Jun 16 00:32:59.681121 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d874be0f-4543-4793-b6e4-5f1e43297035 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Request method failure captured: Jun 16 00:32:59.681121 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230 HTTP/1.1 Jun 16 00:32:59.681121 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:32:59.681121 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:32:59.681121 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:32:59.681121 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:32:59.681121 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:32:59.681121 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:32:59.681121 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:32:59.681121 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:32:59.681121 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnlEQtlTYlcSb6Cxq7ka8JkFDrXY9ZTyYkOKl7RMv-Nc50AOOLvvYPcyo-002Bp2d50a3LSSgJspVILfxuCarFtF9OBY195yuIkdM0DVC_olTUnFngMBTQdDXeOL4IjwWYA5CoVYPq-YWQwNW1R5R2mbX6MVy2x9qf1Ysp-JTmbE9Gk Jun 16 00:32:59.681121 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:32:59.681121 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:32:59.681121 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:32:59.681121 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:32:59.681121 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:32:59.681121 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:32:59.681121 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:32:59.681121 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:32:59.681121 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:32:59.681121 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:32:59.682461 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:32:59.682461 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:32:59.682461 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:32:59.682461 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:32:59.682461 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:32:59.682461 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:32:59.682461 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:32:59.682461 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: 535a03ce19d346d59e6a6f6befb9dea0 Jun 16 00:32:59.682461 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:32:59.682461 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:32:59.682461 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Instance 01d77a9c-3658-4db2-ab07-b248d1c7a230 could not be found. Jun 16 00:32:59.682461 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': '01d77a9c-3658-4db2-ab07-b248d1c7a230'} Jun 16 00:32:59.683201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:32:59.683201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:59.683201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:32:59.683201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:32:59.683201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:32:59.683201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:32:59.683201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:32:59.683201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:32:59.683201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:32:59.683201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:32:59.683201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01d77a9c-3658-4db2-ab07-b248d1c7a230 could not be found. Jun 16 00:32:59.683201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:32:59.683201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:32:59.683201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:32:59.683201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:59.683201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:32:59.683201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:32:59.683201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:32:59.683201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:32:59.683201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:32:59.684446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:32:59.684446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:32:59.684446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:32:59.684446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:32:59.684446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:32:59.684446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:32:59.684446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:32:59.684446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01d77a9c-3658-4db2-ab07-b248d1c7a230 could not be found. Jun 16 00:32:59.684446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:32:59.684446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:32:59.684446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:32:59.684446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:59.684446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:32:59.684446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:32:59.684446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:32:59.684446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:32:59.684446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01d77a9c-3658-4db2-ab07-b248d1c7a230 could not be found. Jun 16 00:32:59.684446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:32:59.685566 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d874be0f-4543-4793-b6e4-5f1e43297035 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Returning 404 to user: Instance 01d77a9c-3658-4db2-ab07-b248d1c7a230 could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:32:59.685566 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-d874be0f-4543-4793-b6e4-5f1e43297035 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230" status: 404 len: 111 microversion: 2.1 time: 0.030294 Jun 16 00:32:59.685566 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 339/662] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:59 2022] GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:32:59.692291 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-3de85ffd-2a81-4e02-ae50-c787ed1a7464 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '.version_select at 0x7fe7048fd550>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:59.711810 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-3de85ffd-2a81-4e02-ae50-c787ed1a7464 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-870672905" status: 202 len: 0 microversion: 2.1 time: 0.023748 Jun 16 00:32:59.712391 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 324/663] 10.222.0.23 () {58 vars in 1217 bytes} [Thu Jun 16 00:32:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-870672905 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:33:00.317153 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-c5a0fe67-f5f4-42d7-a83e-baf63c812e4b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Action: 'create', calling method: .version_select at 0x7fe7049fc820>, body: {"keypair": {"name": "tempest-keypair-1746506704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbS69JitjUBnXHMEueREa0FV0qFlpegjPG+jOBk3c8RP018iRZAkrP9d2KhmCVROdDVbnR8To1hqbduqOECerXnDB/7xcS+wKiHeA/kuboGET2LcjYltz+4SK9ZxoHUEw=="}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:00.331696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-c5a0fe67-f5f4-42d7-a83e-baf63c812e4b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Getting quotas for project 2d5d56c0c6444b23a1ac6cc2fcb0bb52. Resources: {'key_pairs'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:33:00.335754 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-c5a0fe67-f5f4-42d7-a83e-baf63c812e4b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Getting quotas for user 535a03ce19d346d59e6a6f6befb9dea0 and project 2d5d56c0c6444b23a1ac6cc2fcb0bb52. Resources: {'key_pairs'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:33:00.358131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-c5a0fe67-f5f4-42d7-a83e-baf63c812e4b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044838 Jun 16 00:33:00.358715 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 340/664] 10.222.0.23 () {60 vars in 1158 bytes} [Thu Jun 16 00:33:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:00.544026 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c6c8e379-0823-40a4-b9fd-0c9060db03d9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:00.544632 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c6c8e379-0823-40a4-b9fd-0c9060db03d9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:00.550585 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c6c8e379-0823-40a4-b9fd-0c9060db03d9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:00.551031 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c6c8e379-0823-40a4-b9fd-0c9060db03d9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:00.551806 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c6c8e379-0823-40a4-b9fd-0c9060db03d9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:00.552238 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c6c8e379-0823-40a4-b9fd-0c9060db03d9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:00.584035 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-5fbf589b-ec42-40bc-98e7-ee90a03b7fef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:00.584618 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-5fbf589b-ec42-40bc-98e7-ee90a03b7fef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:00.595511 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5fbf589b-ec42-40bc-98e7-ee90a03b7fef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:00.595954 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5fbf589b-ec42-40bc-98e7-ee90a03b7fef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:00.597023 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5fbf589b-ec42-40bc-98e7-ee90a03b7fef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:00.597959 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5fbf589b-ec42-40bc-98e7-ee90a03b7fef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:00.727609 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c6c8e379-0823-40a4-b9fd-0c9060db03d9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:00.735160 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c6c8e379-0823-40a4-b9fd-0c9060db03d9 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1554 microversion: 2.1 time: 0.195727 Jun 16 00:33:00.735943 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 325/665] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:00 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1554 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:00.801405 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-5fbf589b-ec42-40bc-98e7-ee90a03b7fef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:00.809392 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-5fbf589b-ec42-40bc-98e7-ee90a03b7fef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:00.810860 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-5fbf589b-ec42-40bc-98e7-ee90a03b7fef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:00.812002 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-5fbf589b-ec42-40bc-98e7-ee90a03b7fef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1746 microversion: 2.20 time: 0.231952 Jun 16 00:33:00.812565 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 341/666] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:00 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1746 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:33:01.597861 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-3876ec90-0f70-4dc5-ae9c-ef122605c1a5 req-f1027cb1-cceb-48cb-bb56-ddc4162ad019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86b6066-9081-4634-b4da-e5c5ddd72e9d", "name": "network-vif-plugged", "status": "completed", "tag": "308b71f6-0824-4328-b466-16c67900f36f"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:01.616493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-3876ec90-0f70-4dc5-ae9c-ef122605c1a5 req-f1027cb1-cceb-48cb-bb56-ddc4162ad019 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:01.617204 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-3876ec90-0f70-4dc5-ae9c-ef122605c1a5 req-f1027cb1-cceb-48cb-bb56-ddc4162ad019 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:01.648411 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-3876ec90-0f70-4dc5-ae9c-ef122605c1a5 req-f1027cb1-cceb-48cb-bb56-ddc4162ad019 service nova] Creating event network-vif-plugged:308b71f6-0824-4328-b466-16c67900f36f for instance d86b6066-9081-4634-b4da-e5c5ddd72e9d on hv-cinder-84599 Jun 16 00:33:01.660667 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-3876ec90-0f70-4dc5-ae9c-ef122605c1a5 req-f1027cb1-cceb-48cb-bb56-ddc4162ad019 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067109 Jun 16 00:33:01.665480 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 326/667] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:01.753165 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-5b69f4d9-fedc-4649-bdbd-eb0505f879e8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:01.753787 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-5b69f4d9-fedc-4649-bdbd-eb0505f879e8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:01.772320 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5b69f4d9-fedc-4649-bdbd-eb0505f879e8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:01.773020 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5b69f4d9-fedc-4649-bdbd-eb0505f879e8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:01.774204 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5b69f4d9-fedc-4649-bdbd-eb0505f879e8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:01.774950 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5b69f4d9-fedc-4649-bdbd-eb0505f879e8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:01.831872 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d3544a5a-628b-4c0e-a438-e3650f655c34 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:01.832780 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d3544a5a-628b-4c0e-a438-e3650f655c34 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:01.840110 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d3544a5a-628b-4c0e-a438-e3650f655c34 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:01.847253 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d3544a5a-628b-4c0e-a438-e3650f655c34 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:01.849288 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d3544a5a-628b-4c0e-a438-e3650f655c34 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:01.849859 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d3544a5a-628b-4c0e-a438-e3650f655c34 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:01.920146 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-5b69f4d9-fedc-4649-bdbd-eb0505f879e8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d4beaae81b4b8b9e4057f012d18b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87ac732ab7df406c933081dd4939ae1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:01.941004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-5b69f4d9-fedc-4649-bdbd-eb0505f879e8 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 200 len: 1512 microversion: 2.1 time: 0.191834 Jun 16 00:33:01.952454 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 342/668] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:01 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 1512 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:01.957604 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-b9254456-2715-4893-a73e-b59fcaf12fdb req-ceb6795d-fd12-4a37-a7d3-64edddd61507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0750226-e65f-4cfc-94df-46f38bbd623c", "name": "network-vif-deleted", "tag": "cff9c087-7e00-4554-b1a9-538c7504d332"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:01.966655 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-b9254456-2715-4893-a73e-b59fcaf12fdb req-ceb6795d-fd12-4a37-a7d3-64edddd61507 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:01.967121 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-b9254456-2715-4893-a73e-b59fcaf12fdb req-ceb6795d-fd12-4a37-a7d3-64edddd61507 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:01.986473 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-b9254456-2715-4893-a73e-b59fcaf12fdb req-ceb6795d-fd12-4a37-a7d3-64edddd61507 service nova] Creating event network-vif-deleted:cff9c087-7e00-4554-b1a9-538c7504d332 for instance c0750226-e65f-4cfc-94df-46f38bbd623c on hv-cinder-84599 Jun 16 00:33:01.993800 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-b9254456-2715-4893-a73e-b59fcaf12fdb req-ceb6795d-fd12-4a37-a7d3-64edddd61507 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043288 Jun 16 00:33:01.996491 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 343/669] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:02.003461 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-0b77a552-b175-43f3-9274-0453c2ef272f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-915921673", "imageRef": "d9a6de24-7a5e-4f8b-b078-809c87b15d56", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b338e4d-b5e8-4121-bb8b-45875ebd0e07"}], "security_groups": [{"name": "tempest-securitygroup--59143982"}], "key_name": "tempest-keypair-1746506704", "user_data": "}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:02.013116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d3544a5a-628b-4c0e-a438-e3650f655c34 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:02.021794 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d3544a5a-628b-4c0e-a438-e3650f655c34 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:02.030137 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d3544a5a-628b-4c0e-a438-e3650f655c34 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:02.031352 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d3544a5a-628b-4c0e-a438-e3650f655c34 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1741 microversion: 2.20 time: 0.204013 Jun 16 00:33:02.032924 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 327/670] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:01 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1741 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:02.143507 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.network.neutron [None req-0b77a552-b175-43f3-9274-0453c2ef272f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] validate_networks() for [('5b338e4d-b5e8-4121-bb8b-45875ebd0e07', None, None, None, None, None)] {{(pid=124231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:33:02.699598 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-0b77a552-b175-43f3-9274-0453c2ef272f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Flavor limits 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:33:02.700145 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-0b77a552-b175-43f3-9274-0453c2ef272f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Image limits 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:33:02.700700 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-0b77a552-b175-43f3-9274-0453c2ef272f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Flavor pref 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:33:02.701276 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-0b77a552-b175-43f3-9274-0453c2ef272f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Image pref 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:33:02.702328 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-0b77a552-b175-43f3-9274-0453c2ef272f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:33:02.725699 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0b77a552-b175-43f3-9274-0453c2ef272f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:02.725699 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0b77a552-b175-43f3-9274-0453c2ef272f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:02.725699 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0b77a552-b175-43f3-9274-0453c2ef272f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:02.725699 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0b77a552-b175-43f3-9274-0453c2ef272f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:02.744360 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-0b77a552-b175-43f3-9274-0453c2ef272f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Getting quotas for project 2d5d56c0c6444b23a1ac6cc2fcb0bb52. Resources: {'ram', 'cores', 'instances'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:33:02.749059 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-0b77a552-b175-43f3-9274-0453c2ef272f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Getting quotas for user 535a03ce19d346d59e6a6f6befb9dea0 and project 2d5d56c0c6444b23a1ac6cc2fcb0bb52. Resources: {'ram', 'cores', 'instances'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:33:02.773115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-0b77a552-b175-43f3-9274-0453c2ef272f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Going to run 1 instances... {{(pid=124231) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:33:02.775664 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-0b77a552-b175-43f3-9274-0453c2ef272f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d9a6de24-7a5e-4f8b-b078-809c87b15d56',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:33:02.831411 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-0b77a552-b175-43f3-9274-0453c2ef272f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.833477 Jun 16 00:33:02.832282 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 344/671] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Jun 16 00:33:01 2022] POST /compute/v2.1/servers => generated 400 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:33:02.841924 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-ef8a5fd6-2acb-4a05-8c65-2d4e6656b5bf tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:02.842668 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-ef8a5fd6-2acb-4a05-8c65-2d4e6656b5bf tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:02.924919 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-ef8a5fd6-2acb-4a05-8c65-2d4e6656b5bf tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:02.932913 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-ef8a5fd6-2acb-4a05-8c65-2d4e6656b5bf tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065" status: 200 len: 1241 microversion: 2.1 time: 0.094694 Jun 16 00:33:02.933567 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 328/672] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:02 2022] GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065 => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:02.959724 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-9fa03519-a020-435e-be19-8e806a6a173e tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:02.960342 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-9fa03519-a020-435e-be19-8e806a6a173e tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] [instance: c0750226-e65f-4cfc-94df-46f38bbd623c] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:02.968200 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9fa03519-a020-435e-be19-8e806a6a173e tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:02.973943 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9fa03519-a020-435e-be19-8e806a6a173e tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:02.974786 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9fa03519-a020-435e-be19-8e806a6a173e tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:02.977030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9fa03519-a020-435e-be19-8e806a6a173e tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:03.005811 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-9fa03519-a020-435e-be19-8e806a6a173e tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] HTTP exception thrown: Instance c0750226-e65f-4cfc-94df-46f38bbd623c could not be found. Jun 16 00:33:03.007696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-9fa03519-a020-435e-be19-8e806a6a173e tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Request method failure captured: Jun 16 00:33:03.007696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c HTTP/1.1 Jun 16 00:33:03.007696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:33:03.007696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:33:03.007696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:33:03.007696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:33:03.007696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:33:03.007696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:33:03.007696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:33:03.007696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:33:03.007696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnmedLy6MiXOttFAXYWZCu_4JXPN4hU9MCOA3wycrOyNUlUDgPA2C6Jf3ECTnUVClOdGz9cqUUAX4jaupu0OqdMEw71FBXThe_kx9ro2EVrSjdldd1NUlG5j5E-nF7qnzl94lLLSRm1hUEVDsf99DfK2bd4uFjaLv8Ip8VYW-wimGaA Jun 16 00:33:03.007696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:33:03.007696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:33:03.007696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:33:03.007696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:33:03.007696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:33:03.007696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:33:03.007696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: 87ac732ab7df406c933081dd4939ae1e Jun 16 00:33:03.007696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-TestMinimumBasicScenario-63549410 Jun 16 00:33:03.007696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:33:03.007696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:33:03.009241 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_87ac732ab7df406c933081dd4939ae1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/87ac732ab7df406c933081dd4939ae1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/87ac732ab7df406c933081dd4939ae1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/87ac732ab7df406c933081dd4939ae1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:33:03.009241 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-TestMinimumBasicScenario-63549410 Jun 16 00:33:03.009241 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: 87ac732ab7df406c933081dd4939ae1e Jun 16 00:33:03.009241 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-TestMinimumBasicScenario-63549410 Jun 16 00:33:03.009241 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-TestMinimumBasicScenario-63549410-project Jun 16 00:33:03.009241 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:33:03.009241 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:33:03.009241 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: a5d4beaae81b4b8b9e4057f012d18b8b Jun 16 00:33:03.009241 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-TestMinimumBasicScenario-63549410-project Jun 16 00:33:03.009241 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:33:03.009241 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Instance c0750226-e65f-4cfc-94df-46f38bbd623c could not be found. Jun 16 00:33:03.009241 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': 'c0750226-e65f-4cfc-94df-46f38bbd623c'} Jun 16 00:33:03.010982 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:33:03.010982 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:03.010982 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:33:03.010982 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:33:03.010982 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:33:03.010982 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:33:03.010982 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:33:03.010982 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:33:03.010982 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:33:03.010982 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:33:03.010982 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0750226-e65f-4cfc-94df-46f38bbd623c could not be found. Jun 16 00:33:03.010982 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:33:03.010982 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:33:03.010982 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:33:03.010982 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:03.010982 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:33:03.010982 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:33:03.010982 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:33:03.010982 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:33:03.010982 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:33:03.013463 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:33:03.013463 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:33:03.013463 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:33:03.013463 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:33:03.013463 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:33:03.013463 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:33:03.013463 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:33:03.013463 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0750226-e65f-4cfc-94df-46f38bbd623c could not be found. Jun 16 00:33:03.013463 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:33:03.013463 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:33:03.013463 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:33:03.013463 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:03.013463 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:33:03.013463 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:33:03.013463 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:33:03.013463 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:33:03.013463 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0750226-e65f-4cfc-94df-46f38bbd623c could not be found. Jun 16 00:33:03.013463 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:33:03.017349 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-9fa03519-a020-435e-be19-8e806a6a173e tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Returning 404 to user: Instance c0750226-e65f-4cfc-94df-46f38bbd623c could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:33:03.019157 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-9fa03519-a020-435e-be19-8e806a6a173e tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c" status: 404 len: 111 microversion: 2.1 time: 0.063310 Jun 16 00:33:03.019890 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 345/673] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:02 2022] GET /compute/v2.1/servers/c0750226-e65f-4cfc-94df-46f38bbd623c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:33:03.028157 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-642673d1-aaaf-4eb2-adbf-633952b93605 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] Calling method '.version_select at 0x7fe704aaf4c0>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:03.051097 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d5320ef3-b4d5-4cad-b1ca-c8e0351d8fae tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:03.052240 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-d5320ef3-b4d5-4cad-b1ca-c8e0351d8fae tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:03.058874 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-642673d1-aaaf-4eb2-adbf-633952b93605 tempest-TestMinimumBasicScenario-63549410 tempest-TestMinimumBasicScenario-63549410-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-436131327" status: 202 len: 0 microversion: 2.1 time: 0.034178 Jun 16 00:33:03.059906 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 329/674] 10.222.0.23 () {58 vars in 1268 bytes} [Thu Jun 16 00:33:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-436131327 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:33:03.076836 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d5320ef3-b4d5-4cad-b1ca-c8e0351d8fae tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:03.078836 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d5320ef3-b4d5-4cad-b1ca-c8e0351d8fae tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:03.081208 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d5320ef3-b4d5-4cad-b1ca-c8e0351d8fae tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:03.088626 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d5320ef3-b4d5-4cad-b1ca-c8e0351d8fae tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:03.305731 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d5320ef3-b4d5-4cad-b1ca-c8e0351d8fae tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:03.316658 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d5320ef3-b4d5-4cad-b1ca-c8e0351d8fae tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:03.319020 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d5320ef3-b4d5-4cad-b1ca-c8e0351d8fae tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:03.320298 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-d5320ef3-b4d5-4cad-b1ca-c8e0351d8fae tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1741 microversion: 2.20 time: 0.274285 Jun 16 00:33:03.321363 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 346/675] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:03 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1741 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:03.953146 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-42d64898-8856-424f-9ed8-6de3f7331514 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:03.954567 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-42d64898-8856-424f-9ed8-6de3f7331514 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:03.963256 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-42d64898-8856-424f-9ed8-6de3f7331514 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:03.964549 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-42d64898-8856-424f-9ed8-6de3f7331514 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:03.965608 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-42d64898-8856-424f-9ed8-6de3f7331514 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:03.967240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-42d64898-8856-424f-9ed8-6de3f7331514 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:04.054642 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-42d64898-8856-424f-9ed8-6de3f7331514 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:04.064394 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-42d64898-8856-424f-9ed8-6de3f7331514 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065" status: 200 len: 1293 microversion: 2.1 time: 0.117448 Jun 16 00:33:04.065509 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 330/676] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:03 2022] GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065 => generated 1293 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:04.338248 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-ea9df904-6574-4571-962d-a211b5f8533a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:04.338845 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-ea9df904-6574-4571-962d-a211b5f8533a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:04.341575 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:04.350739 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ea9df904-6574-4571-962d-a211b5f8533a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:04.351167 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ea9df904-6574-4571-962d-a211b5f8533a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:04.354017 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ea9df904-6574-4571-962d-a211b5f8533a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:04.354459 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ea9df904-6574-4571-962d-a211b5f8533a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:04.743845 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-ea9df904-6574-4571-962d-a211b5f8533a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:04.753216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-ea9df904-6574-4571-962d-a211b5f8533a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:04.758088 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-ea9df904-6574-4571-962d-a211b5f8533a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:04.766125 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-ea9df904-6574-4571-962d-a211b5f8533a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1741 microversion: 2.20 time: 0.431106 Jun 16 00:33:04.767044 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 347/677] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:04 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1741 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:05.095549 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-2054885d-5aee-4ce6-b8ff-688bd9b02108 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:05.102885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-2054885d-5aee-4ce6-b8ff-688bd9b02108 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:05.127562 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2054885d-5aee-4ce6-b8ff-688bd9b02108 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:05.128444 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2054885d-5aee-4ce6-b8ff-688bd9b02108 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:05.129960 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2054885d-5aee-4ce6-b8ff-688bd9b02108 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:05.130656 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2054885d-5aee-4ce6-b8ff-688bd9b02108 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:05.501861 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-2054885d-5aee-4ce6-b8ff-688bd9b02108 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:05.512037 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-2054885d-5aee-4ce6-b8ff-688bd9b02108 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065" status: 200 len: 1365 microversion: 2.1 time: 0.433397 Jun 16 00:33:05.513769 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 331/678] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:05 2022] GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065 => generated 1365 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:05.792559 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-2187e4f1-ead7-4ee7-aa71-6a603d8f2830 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:05.793644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-2187e4f1-ead7-4ee7-aa71-6a603d8f2830 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:05.804796 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2187e4f1-ead7-4ee7-aa71-6a603d8f2830 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:05.805275 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2187e4f1-ead7-4ee7-aa71-6a603d8f2830 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:05.806038 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2187e4f1-ead7-4ee7-aa71-6a603d8f2830 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:05.813164 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2187e4f1-ead7-4ee7-aa71-6a603d8f2830 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:05.863292 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:06.108638 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-2187e4f1-ead7-4ee7-aa71-6a603d8f2830 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:06.127372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-2187e4f1-ead7-4ee7-aa71-6a603d8f2830 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:06.129408 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-2187e4f1-ead7-4ee7-aa71-6a603d8f2830 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:06.131133 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-2187e4f1-ead7-4ee7-aa71-6a603d8f2830 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1741 microversion: 2.20 time: 0.348662 Jun 16 00:33:06.132319 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 348/679] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:05 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1741 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:06.248127 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-57a1080e-5e60-4361-a50e-e91e90190276 req-467340c7-ae78-4e5d-8806-de2d1b4aa6aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4f4cf51-b32f-46a8-9829-d4365ec4d065", "tag": "7d000d19-ae48-45c1-9193-30611893d3b3"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:06.264544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-57a1080e-5e60-4361-a50e-e91e90190276 req-467340c7-ae78-4e5d-8806-de2d1b4aa6aa service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:06.275342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-57a1080e-5e60-4361-a50e-e91e90190276 req-467340c7-ae78-4e5d-8806-de2d1b4aa6aa service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:06.326637 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-57a1080e-5e60-4361-a50e-e91e90190276 req-467340c7-ae78-4e5d-8806-de2d1b4aa6aa service nova] Creating event network-changed:7d000d19-ae48-45c1-9193-30611893d3b3 for instance a4f4cf51-b32f-46a8-9829-d4365ec4d065 on hv-cinder-84599 Jun 16 00:33:06.364970 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-57a1080e-5e60-4361-a50e-e91e90190276 req-467340c7-ae78-4e5d-8806-de2d1b4aa6aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120239 Jun 16 00:33:06.366539 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 332/680] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:33:06.532948 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-70845d00-424a-43e2-9523-fb6f73392a41 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:06.533541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-70845d00-424a-43e2-9523-fb6f73392a41 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:06.542095 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-70845d00-424a-43e2-9523-fb6f73392a41 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:06.542836 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-70845d00-424a-43e2-9523-fb6f73392a41 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:06.543839 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-70845d00-424a-43e2-9523-fb6f73392a41 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:06.544485 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-70845d00-424a-43e2-9523-fb6f73392a41 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:06.794961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-70845d00-424a-43e2-9523-fb6f73392a41 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:06.808763 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-70845d00-424a-43e2-9523-fb6f73392a41 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065" status: 200 len: 1365 microversion: 2.1 time: 0.280796 Jun 16 00:33:06.818634 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 349/681] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:06 2022] GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065 => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:07.150921 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-e1761676-b75c-4845-9d89-8fa43a582fc1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:07.151971 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-e1761676-b75c-4845-9d89-8fa43a582fc1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:07.164385 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e1761676-b75c-4845-9d89-8fa43a582fc1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:07.165086 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e1761676-b75c-4845-9d89-8fa43a582fc1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:07.166494 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e1761676-b75c-4845-9d89-8fa43a582fc1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:07.167267 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e1761676-b75c-4845-9d89-8fa43a582fc1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:07.519598 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-e1761676-b75c-4845-9d89-8fa43a582fc1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:07.535317 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-e1761676-b75c-4845-9d89-8fa43a582fc1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:07.537793 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-e1761676-b75c-4845-9d89-8fa43a582fc1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:07.540286 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-e1761676-b75c-4845-9d89-8fa43a582fc1 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1741 microversion: 2.20 time: 0.394320 Jun 16 00:33:07.541734 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 333/682] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:07 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1741 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:07.827364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-cedc97c6-40bf-4922-aa38-023102225fd6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:07.827364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-cedc97c6-40bf-4922-aa38-023102225fd6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:07.845195 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cedc97c6-40bf-4922-aa38-023102225fd6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:07.846033 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cedc97c6-40bf-4922-aa38-023102225fd6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:07.847087 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cedc97c6-40bf-4922-aa38-023102225fd6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:07.847610 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cedc97c6-40bf-4922-aa38-023102225fd6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:08.041827 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-cedc97c6-40bf-4922-aa38-023102225fd6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:08.059875 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-cedc97c6-40bf-4922-aa38-023102225fd6 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065" status: 200 len: 1365 microversion: 2.1 time: 0.235073 Jun 16 00:33:08.060799 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 350/683] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:07 2022] GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:08.569841 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-48ea4c03-2913-4063-8f68-72bb58bb1b63 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:08.570542 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-48ea4c03-2913-4063-8f68-72bb58bb1b63 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:08.582918 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-48ea4c03-2913-4063-8f68-72bb58bb1b63 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:08.583471 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-48ea4c03-2913-4063-8f68-72bb58bb1b63 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:08.584136 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-48ea4c03-2913-4063-8f68-72bb58bb1b63 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:08.584564 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-48ea4c03-2913-4063-8f68-72bb58bb1b63 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:09.079110 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-58cdb945-8b9a-4b65-9a1e-ecf8e7e16be1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:09.079831 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-58cdb945-8b9a-4b65-9a1e-ecf8e7e16be1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:09.084117 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-48ea4c03-2913-4063-8f68-72bb58bb1b63 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:09.086011 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-58cdb945-8b9a-4b65-9a1e-ecf8e7e16be1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:09.086464 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-58cdb945-8b9a-4b65-9a1e-ecf8e7e16be1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:09.087437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-58cdb945-8b9a-4b65-9a1e-ecf8e7e16be1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:09.088083 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-58cdb945-8b9a-4b65-9a1e-ecf8e7e16be1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:09.101281 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-48ea4c03-2913-4063-8f68-72bb58bb1b63 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:09.106095 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-48ea4c03-2913-4063-8f68-72bb58bb1b63 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:09.108406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-48ea4c03-2913-4063-8f68-72bb58bb1b63 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1741 microversion: 2.20 time: 0.549935 Jun 16 00:33:09.110188 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 334/684] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:08 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1741 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:09.246699 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-58cdb945-8b9a-4b65-9a1e-ecf8e7e16be1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:09.255627 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-58cdb945-8b9a-4b65-9a1e-ecf8e7e16be1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065" status: 200 len: 1365 microversion: 2.1 time: 0.180710 Jun 16 00:33:09.256948 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 351/685] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:09 2022] GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:10.137378 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-f117e363-cde3-4c79-b5a4-47147506280d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:10.138923 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-f117e363-cde3-4c79-b5a4-47147506280d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:10.153282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f117e363-cde3-4c79-b5a4-47147506280d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:10.158891 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f117e363-cde3-4c79-b5a4-47147506280d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:10.159902 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f117e363-cde3-4c79-b5a4-47147506280d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:10.160342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f117e363-cde3-4c79-b5a4-47147506280d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:10.289452 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-4202d4c4-c9c0-4de8-b47b-5d4838e5802b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:10.304764 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-4202d4c4-c9c0-4de8-b47b-5d4838e5802b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:10.333566 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4202d4c4-c9c0-4de8-b47b-5d4838e5802b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:10.338063 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4202d4c4-c9c0-4de8-b47b-5d4838e5802b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:10.339192 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4202d4c4-c9c0-4de8-b47b-5d4838e5802b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:10.340776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4202d4c4-c9c0-4de8-b47b-5d4838e5802b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:10.435696 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f117e363-cde3-4c79-b5a4-47147506280d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:10.447410 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f117e363-cde3-4c79-b5a4-47147506280d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:10.450281 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f117e363-cde3-4c79-b5a4-47147506280d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:10.452322 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-f117e363-cde3-4c79-b5a4-47147506280d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1741 microversion: 2.20 time: 0.319758 Jun 16 00:33:10.453672 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 335/686] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:10 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1741 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:10.533533 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-4202d4c4-c9c0-4de8-b47b-5d4838e5802b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:10.542656 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-4202d4c4-c9c0-4de8-b47b-5d4838e5802b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065" status: 200 len: 1365 microversion: 2.1 time: 0.271880 Jun 16 00:33:10.543328 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 352/687] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:10 2022] GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065 => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:11.471828 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-cdf6bd93-0907-4904-93a9-1443be2a027d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:11.472377 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-cdf6bd93-0907-4904-93a9-1443be2a027d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:11.479333 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-cdf6bd93-0907-4904-93a9-1443be2a027d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:11.479779 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-cdf6bd93-0907-4904-93a9-1443be2a027d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:11.480559 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-cdf6bd93-0907-4904-93a9-1443be2a027d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:11.481028 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-cdf6bd93-0907-4904-93a9-1443be2a027d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:11.566562 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-5e27481c-28c1-4b2c-a6dd-855e4e55d762 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:11.569911 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-5e27481c-28c1-4b2c-a6dd-855e4e55d762 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:11.585597 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5e27481c-28c1-4b2c-a6dd-855e4e55d762 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:11.589364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5e27481c-28c1-4b2c-a6dd-855e4e55d762 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:11.590746 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5e27481c-28c1-4b2c-a6dd-855e4e55d762 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:11.591888 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5e27481c-28c1-4b2c-a6dd-855e4e55d762 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:11.704927 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-cdf6bd93-0907-4904-93a9-1443be2a027d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:11.720252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-cdf6bd93-0907-4904-93a9-1443be2a027d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:11.723852 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-cdf6bd93-0907-4904-93a9-1443be2a027d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:11.725773 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-cdf6bd93-0907-4904-93a9-1443be2a027d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1741 microversion: 2.20 time: 0.257752 Jun 16 00:33:11.727560 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 336/688] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:11 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1741 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:12.192642 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-5e27481c-28c1-4b2c-a6dd-855e4e55d762 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:12.207615 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-5e27481c-28c1-4b2c-a6dd-855e4e55d762 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065" status: 200 len: 1365 microversion: 2.1 time: 0.645079 Jun 16 00:33:12.209274 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 353/689] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:11 2022] GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065 => generated 1365 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:33:12.746988 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-1bc55737-ea02-495e-944d-3f61b84a4afd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:12.747608 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-1bc55737-ea02-495e-944d-3f61b84a4afd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:12.754971 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1bc55737-ea02-495e-944d-3f61b84a4afd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:12.755643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1bc55737-ea02-495e-944d-3f61b84a4afd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:12.756651 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1bc55737-ea02-495e-944d-3f61b84a4afd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:12.757298 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1bc55737-ea02-495e-944d-3f61b84a4afd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:12.931695 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-1bc55737-ea02-495e-944d-3f61b84a4afd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:12.942918 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=2 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:12.943802 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:12.947169 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-1bc55737-ea02-495e-944d-3f61b84a4afd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:12.949040 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-1bc55737-ea02-495e-944d-3f61b84a4afd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:12.951547 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-1bc55737-ea02-495e-944d-3f61b84a4afd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1741 microversion: 2.20 time: 0.208731 Jun 16 00:33:12.954303 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 337/690] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:12 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1741 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:13.228570 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-8a0257d2-46d6-415d-9def-8671310d1aea tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:13.230041 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-8a0257d2-46d6-415d-9def-8671310d1aea tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:13.238662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=2 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:13.239799 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=10 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:13.241961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8a0257d2-46d6-415d-9def-8671310d1aea tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:13.242731 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8a0257d2-46d6-415d-9def-8671310d1aea tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:13.243914 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8a0257d2-46d6-415d-9def-8671310d1aea tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:13.244620 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8a0257d2-46d6-415d-9def-8671310d1aea tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:13.403644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-8a0257d2-46d6-415d-9def-8671310d1aea tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:13.411728 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-8a0257d2-46d6-415d-9def-8671310d1aea tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065" status: 200 len: 1365 microversion: 2.1 time: 0.188248 Jun 16 00:33:13.412303 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 354/691] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:13 2022] GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:13.696620 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-68279154-0bcc-4eee-999e-8038885e610b req-3a7a3e53-6e4a-4c6d-886d-fee1c83e1249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4f4cf51-b32f-46a8-9829-d4365ec4d065", "name": "network-vif-plugged", "status": "completed", "tag": "7d000d19-ae48-45c1-9193-30611893d3b3"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:13.709160 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-68279154-0bcc-4eee-999e-8038885e610b req-3a7a3e53-6e4a-4c6d-886d-fee1c83e1249 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:13.709608 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-68279154-0bcc-4eee-999e-8038885e610b req-3a7a3e53-6e4a-4c6d-886d-fee1c83e1249 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:13.735684 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-68279154-0bcc-4eee-999e-8038885e610b req-3a7a3e53-6e4a-4c6d-886d-fee1c83e1249 service nova] Creating event network-vif-plugged:7d000d19-ae48-45c1-9193-30611893d3b3 for instance a4f4cf51-b32f-46a8-9829-d4365ec4d065 on hv-cinder-84599 Jun 16 00:33:13.748189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-68279154-0bcc-4eee-999e-8038885e610b req-3a7a3e53-6e4a-4c6d-886d-fee1c83e1249 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070120 Jun 16 00:33:13.749799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 338/692] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:13.973397 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-385050fc-89d2-443a-8fa4-753b7e16865b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:13.974346 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-385050fc-89d2-443a-8fa4-753b7e16865b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:13.986247 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-385050fc-89d2-443a-8fa4-753b7e16865b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:13.986944 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-385050fc-89d2-443a-8fa4-753b7e16865b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:13.988743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-385050fc-89d2-443a-8fa4-753b7e16865b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:13.990038 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-385050fc-89d2-443a-8fa4-753b7e16865b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:14.240610 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-385050fc-89d2-443a-8fa4-753b7e16865b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:14.247395 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-385050fc-89d2-443a-8fa4-753b7e16865b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:14.248941 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-385050fc-89d2-443a-8fa4-753b7e16865b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:14.250910 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-385050fc-89d2-443a-8fa4-753b7e16865b tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1723 microversion: 2.20 time: 0.282389 Jun 16 00:33:14.251660 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 355/693] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:13 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:14.429803 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-3e920e69-7a4f-47bf-8f99-7acfb4486f5f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:14.430625 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-3e920e69-7a4f-47bf-8f99-7acfb4486f5f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:14.438894 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3e920e69-7a4f-47bf-8f99-7acfb4486f5f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:14.439420 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3e920e69-7a4f-47bf-8f99-7acfb4486f5f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:14.440425 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3e920e69-7a4f-47bf-8f99-7acfb4486f5f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:14.440973 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3e920e69-7a4f-47bf-8f99-7acfb4486f5f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:14.695052 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-3e920e69-7a4f-47bf-8f99-7acfb4486f5f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:14.702529 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-3e920e69-7a4f-47bf-8f99-7acfb4486f5f tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065" status: 200 len: 1365 microversion: 2.1 time: 0.276974 Jun 16 00:33:14.704932 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 339/694] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:14 2022] GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065 => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:15.268995 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-95bc9376-4657-4837-944e-5138ca1e9c40 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:15.269608 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-95bc9376-4657-4837-944e-5138ca1e9c40 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:15.277023 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-95bc9376-4657-4837-944e-5138ca1e9c40 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:15.277476 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-95bc9376-4657-4837-944e-5138ca1e9c40 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:15.278244 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-95bc9376-4657-4837-944e-5138ca1e9c40 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:15.278680 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-95bc9376-4657-4837-944e-5138ca1e9c40 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:15.411642 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-95bc9376-4657-4837-944e-5138ca1e9c40 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:15.419749 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-95bc9376-4657-4837-944e-5138ca1e9c40 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:15.421471 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-95bc9376-4657-4837-944e-5138ca1e9c40 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:15.422554 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-95bc9376-4657-4837-944e-5138ca1e9c40 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1723 microversion: 2.20 time: 0.157594 Jun 16 00:33:15.423114 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 356/695] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:15 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:15.720986 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-2ebce1f9-98b9-4052-845f-6145de71e4b0 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:15.726416 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-2ebce1f9-98b9-4052-845f-6145de71e4b0 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:15.732993 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2ebce1f9-98b9-4052-845f-6145de71e4b0 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:15.733444 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2ebce1f9-98b9-4052-845f-6145de71e4b0 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:15.734541 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2ebce1f9-98b9-4052-845f-6145de71e4b0 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:15.735059 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2ebce1f9-98b9-4052-845f-6145de71e4b0 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:15.872125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-2ebce1f9-98b9-4052-845f-6145de71e4b0 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:15.879534 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-2ebce1f9-98b9-4052-845f-6145de71e4b0 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065" status: 200 len: 1365 microversion: 2.1 time: 0.162441 Jun 16 00:33:15.880091 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 340/696] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:15 2022] GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:16.440302 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d5e19c78-cae1-46b2-830a-cb2daa607cef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:16.440940 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-d5e19c78-cae1-46b2-830a-cb2daa607cef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:16.447550 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d5e19c78-cae1-46b2-830a-cb2daa607cef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:16.447990 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d5e19c78-cae1-46b2-830a-cb2daa607cef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:16.448746 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d5e19c78-cae1-46b2-830a-cb2daa607cef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:16.449196 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d5e19c78-cae1-46b2-830a-cb2daa607cef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:16.757219 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d5e19c78-cae1-46b2-830a-cb2daa607cef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:16.766264 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d5e19c78-cae1-46b2-830a-cb2daa607cef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:16.768154 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d5e19c78-cae1-46b2-830a-cb2daa607cef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:16.769193 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-d5e19c78-cae1-46b2-830a-cb2daa607cef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1723 microversion: 2.20 time: 0.333251 Jun 16 00:33:16.769745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 357/697] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:16 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1723 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:16.898699 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-772b43fb-065e-4bb1-823f-9dc7ef9f4f29 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:16.899428 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-772b43fb-065e-4bb1-823f-9dc7ef9f4f29 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:16.907686 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-772b43fb-065e-4bb1-823f-9dc7ef9f4f29 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:16.908634 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-772b43fb-065e-4bb1-823f-9dc7ef9f4f29 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:16.909928 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-772b43fb-065e-4bb1-823f-9dc7ef9f4f29 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:16.910574 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-772b43fb-065e-4bb1-823f-9dc7ef9f4f29 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:17.081768 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-772b43fb-065e-4bb1-823f-9dc7ef9f4f29 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:17.091381 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-772b43fb-065e-4bb1-823f-9dc7ef9f4f29 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065" status: 200 len: 1554 microversion: 2.1 time: 0.198520 Jun 16 00:33:17.091976 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 341/698] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:16 2022] GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065 => generated 1554 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:33:17.114446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-7afc17cb-dfbe-4cd6-8fe3-cf7e95f6a70d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:17.117949 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-7afc17cb-dfbe-4cd6-8fe3-cf7e95f6a70d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:17.129614 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7afc17cb-dfbe-4cd6-8fe3-cf7e95f6a70d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:17.130146 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7afc17cb-dfbe-4cd6-8fe3-cf7e95f6a70d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:17.137271 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7afc17cb-dfbe-4cd6-8fe3-cf7e95f6a70d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:17.138416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7afc17cb-dfbe-4cd6-8fe3-cf7e95f6a70d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:17.282440 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-7afc17cb-dfbe-4cd6-8fe3-cf7e95f6a70d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.177625 Jun 16 00:33:17.283112 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 358/699] 10.222.0.23 () {58 vars in 1274 bytes} [Thu Jun 16 00:33:17 2022] GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065/os-interface => generated 284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:17.565574 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-08d4357b-3ae7-4f96-a4ad-465ff5cae2f8 req-88520c32-ec91-4377-bfae-00fbff7a744b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86b6066-9081-4634-b4da-e5c5ddd72e9d", "name": "network-vif-unplugged", "status": "completed", "tag": "308b71f6-0824-4328-b466-16c67900f36f"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:17.574810 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-08d4357b-3ae7-4f96-a4ad-465ff5cae2f8 req-88520c32-ec91-4377-bfae-00fbff7a744b service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:17.575382 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-08d4357b-3ae7-4f96-a4ad-465ff5cae2f8 req-88520c32-ec91-4377-bfae-00fbff7a744b service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:17.588110 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.compute.server_external_events [req-08d4357b-3ae7-4f96-a4ad-465ff5cae2f8 req-88520c32-ec91-4377-bfae-00fbff7a744b service nova] Unable to find a host for instance d86b6066-9081-4634-b4da-e5c5ddd72e9d. Dropping event network-vif-unplugged {{(pid=124230) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 00:33:17.589383 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-08d4357b-3ae7-4f96-a4ad-465ff5cae2f8 req-88520c32-ec91-4377-bfae-00fbff7a744b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028484 Jun 16 00:33:17.590174 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 342/700] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 00:33:17.787788 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-c67a4611-c1f3-439d-9bd0-fbc3e5384751 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:17.789054 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-c67a4611-c1f3-439d-9bd0-fbc3e5384751 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:17.795419 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c67a4611-c1f3-439d-9bd0-fbc3e5384751 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:17.796078 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c67a4611-c1f3-439d-9bd0-fbc3e5384751 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:17.797419 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c67a4611-c1f3-439d-9bd0-fbc3e5384751 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:17.798022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c67a4611-c1f3-439d-9bd0-fbc3e5384751 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:18.048867 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-c67a4611-c1f3-439d-9bd0-fbc3e5384751 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:18.060974 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-c67a4611-c1f3-439d-9bd0-fbc3e5384751 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:18.064911 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-c67a4611-c1f3-439d-9bd0-fbc3e5384751 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:18.067229 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-c67a4611-c1f3-439d-9bd0-fbc3e5384751 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1666 microversion: 2.20 time: 0.283614 Jun 16 00:33:18.090572 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 359/701] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:17 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1666 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:18.090988 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-a5a3c6c4-60a7-47a0-8af0-63e9bc0f2070 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4a6d0cd-9274-46b3-9cf9-464944221937"}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:18.092103 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-a5a3c6c4-60a7-47a0-8af0-63e9bc0f2070 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:18.100061 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a5a3c6c4-60a7-47a0-8af0-63e9bc0f2070 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:18.100575 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a5a3c6c4-60a7-47a0-8af0-63e9bc0f2070 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:18.101513 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a5a3c6c4-60a7-47a0-8af0-63e9bc0f2070 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:18.101961 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a5a3c6c4-60a7-47a0-8af0-63e9bc0f2070 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:18.457717 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-7bc4807d-05db-46b6-b1e8-25122c859dc9 req-dcf5a601-205e-4f43-89e1-54abf10a8c27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4f4cf51-b32f-46a8-9829-d4365ec4d065", "tag": "7d000d19-ae48-45c1-9193-30611893d3b3"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:18.474532 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-7bc4807d-05db-46b6-b1e8-25122c859dc9 req-dcf5a601-205e-4f43-89e1-54abf10a8c27 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:18.474965 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-7bc4807d-05db-46b6-b1e8-25122c859dc9 req-dcf5a601-205e-4f43-89e1-54abf10a8c27 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:18.505346 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-7bc4807d-05db-46b6-b1e8-25122c859dc9 req-dcf5a601-205e-4f43-89e1-54abf10a8c27 service nova] Creating event network-changed:7d000d19-ae48-45c1-9193-30611893d3b3 for instance a4f4cf51-b32f-46a8-9829-d4365ec4d065 on hv-cinder-84599 Jun 16 00:33:18.511308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-7bc4807d-05db-46b6-b1e8-25122c859dc9 req-dcf5a601-205e-4f43-89e1-54abf10a8c27 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056957 Jun 16 00:33:18.512496 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 360/702] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:18.598546 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-a5a3c6c4-60a7-47a0-8af0-63e9bc0f2070 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "POST /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.511712 Jun 16 00:33:18.599345 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 343/703] 10.222.0.23 () {62 vars in 1363 bytes} [Thu Jun 16 00:33:18 2022] POST /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d/os-volume_attachments => generated 188 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 00:33:18.774688 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d69e4b84-148e-4416-9ed3-3ae10486b013 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:18.776153 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-d69e4b84-148e-4416-9ed3-3ae10486b013 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:18.784253 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d69e4b84-148e-4416-9ed3-3ae10486b013 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:18.784910 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d69e4b84-148e-4416-9ed3-3ae10486b013 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:18.785857 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d69e4b84-148e-4416-9ed3-3ae10486b013 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:18.786437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d69e4b84-148e-4416-9ed3-3ae10486b013 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:19.173770 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-d69e4b84-148e-4416-9ed3-3ae10486b013 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d/os-volume_attachments/f4a6d0cd-9274-46b3-9cf9-464944221937" status: 202 len: 0 microversion: 2.20 time: 0.404786 Jun 16 00:33:19.175967 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 361/704] 10.222.0.23 () {60 vars in 1456 bytes} [Thu Jun 16 00:33:18 2022] DELETE /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d/os-volume_attachments/f4a6d0cd-9274-46b3-9cf9-464944221937 => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:33:19.261440 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-e6826a23-2804-4d03-a7fe-bcffe0290d36 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:19.262020 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-e6826a23-2804-4d03-a7fe-bcffe0290d36 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:19.272889 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e6826a23-2804-4d03-a7fe-bcffe0290d36 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:19.276595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e6826a23-2804-4d03-a7fe-bcffe0290d36 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:19.277493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e6826a23-2804-4d03-a7fe-bcffe0290d36 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:19.278115 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e6826a23-2804-4d03-a7fe-bcffe0290d36 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:19.429090 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-e6826a23-2804-4d03-a7fe-bcffe0290d36 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "POST /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d/action" status: 202 len: 0 microversion: 2.20 time: 0.171119 Jun 16 00:33:19.430259 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 344/705] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Jun 16 00:33:19 2022] POST /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:33:19.438644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-9a4b0c48-23fc-432a-837f-9894f3f4d105 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:19.439254 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-9a4b0c48-23fc-432a-837f-9894f3f4d105 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:19.451184 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9a4b0c48-23fc-432a-837f-9894f3f4d105 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:19.451626 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9a4b0c48-23fc-432a-837f-9894f3f4d105 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:19.452817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9a4b0c48-23fc-432a-837f-9894f3f4d105 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:19.453401 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9a4b0c48-23fc-432a-837f-9894f3f4d105 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:19.701160 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-9a4b0c48-23fc-432a-837f-9894f3f4d105 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:19.713804 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-9a4b0c48-23fc-432a-837f-9894f3f4d105 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:19.727733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-9a4b0c48-23fc-432a-837f-9894f3f4d105 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:19.729011 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-9a4b0c48-23fc-432a-837f-9894f3f4d105 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1674 microversion: 2.20 time: 0.294546 Jun 16 00:33:19.741427 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 362/706] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:19 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1674 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:20.750807 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5d4e0e16-25b9-4713-8ede-a95c70befe4d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:20.751420 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-5d4e0e16-25b9-4713-8ede-a95c70befe4d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:20.761333 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:20.767346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5d4e0e16-25b9-4713-8ede-a95c70befe4d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:20.768082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5d4e0e16-25b9-4713-8ede-a95c70befe4d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:20.778496 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5d4e0e16-25b9-4713-8ede-a95c70befe4d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:20.779095 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5d4e0e16-25b9-4713-8ede-a95c70befe4d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:20.998091 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-5d4e0e16-25b9-4713-8ede-a95c70befe4d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:21.011485 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-5d4e0e16-25b9-4713-8ede-a95c70befe4d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:21.013258 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-5d4e0e16-25b9-4713-8ede-a95c70befe4d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:21.015517 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-5d4e0e16-25b9-4713-8ede-a95c70befe4d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1674 microversion: 2.20 time: 0.269184 Jun 16 00:33:21.021035 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 345/707] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:20 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1674 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:22.038684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-f9addd76-6a68-4a0a-9cc0-6c4c92f4bd2f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:22.039291 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-f9addd76-6a68-4a0a-9cc0-6c4c92f4bd2f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:22.046544 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f9addd76-6a68-4a0a-9cc0-6c4c92f4bd2f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:22.047130 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f9addd76-6a68-4a0a-9cc0-6c4c92f4bd2f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:22.047900 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f9addd76-6a68-4a0a-9cc0-6c4c92f4bd2f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:22.048511 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f9addd76-6a68-4a0a-9cc0-6c4c92f4bd2f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:22.251870 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-f9addd76-6a68-4a0a-9cc0-6c4c92f4bd2f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:22.259842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:22.264131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-f9addd76-6a68-4a0a-9cc0-6c4c92f4bd2f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:22.266255 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-f9addd76-6a68-4a0a-9cc0-6c4c92f4bd2f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:22.268314 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-f9addd76-6a68-4a0a-9cc0-6c4c92f4bd2f tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1732 microversion: 2.20 time: 0.234972 Jun 16 00:33:22.269627 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 363/708] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:22 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1732 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:23.287944 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-4bcdfbfb-460c-4521-82fc-b7bf46df1ae0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:23.288624 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-4bcdfbfb-460c-4521-82fc-b7bf46df1ae0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:23.301898 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4bcdfbfb-460c-4521-82fc-b7bf46df1ae0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:23.302422 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4bcdfbfb-460c-4521-82fc-b7bf46df1ae0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:23.303208 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4bcdfbfb-460c-4521-82fc-b7bf46df1ae0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:23.305127 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4bcdfbfb-460c-4521-82fc-b7bf46df1ae0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:24.514114 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-4bcdfbfb-460c-4521-82fc-b7bf46df1ae0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:24.547760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-4bcdfbfb-460c-4521-82fc-b7bf46df1ae0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:24.549572 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-4bcdfbfb-460c-4521-82fc-b7bf46df1ae0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:24.550862 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-4bcdfbfb-460c-4521-82fc-b7bf46df1ae0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1732 microversion: 2.20 time: 1.266952 Jun 16 00:33:24.562178 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 346/709] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:23 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1732 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:33:25.570545 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-8519f8d9-4b9a-4708-9f4d-fc809ff65edf tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:25.571922 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-8519f8d9-4b9a-4708-9f4d-fc809ff65edf tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:25.602594 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8519f8d9-4b9a-4708-9f4d-fc809ff65edf tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:25.605359 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8519f8d9-4b9a-4708-9f4d-fc809ff65edf tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:25.609596 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8519f8d9-4b9a-4708-9f4d-fc809ff65edf tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:25.610299 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8519f8d9-4b9a-4708-9f4d-fc809ff65edf tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:25.982664 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-8519f8d9-4b9a-4708-9f4d-fc809ff65edf tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:26.000519 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-8519f8d9-4b9a-4708-9f4d-fc809ff65edf tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:26.002345 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-8519f8d9-4b9a-4708-9f4d-fc809ff65edf tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:26.004757 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-8519f8d9-4b9a-4708-9f4d-fc809ff65edf tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1732 microversion: 2.20 time: 0.439079 Jun 16 00:33:26.009198 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 364/710] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:25 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1732 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:27.027510 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-56804a37-23d2-40e6-8453-52fb6381961e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:27.028099 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-56804a37-23d2-40e6-8453-52fb6381961e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:27.037330 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-56804a37-23d2-40e6-8453-52fb6381961e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:27.037780 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-56804a37-23d2-40e6-8453-52fb6381961e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:27.038555 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-56804a37-23d2-40e6-8453-52fb6381961e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:27.038984 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-56804a37-23d2-40e6-8453-52fb6381961e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:27.439574 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-56804a37-23d2-40e6-8453-52fb6381961e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:27.455914 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-56804a37-23d2-40e6-8453-52fb6381961e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:27.459947 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-56804a37-23d2-40e6-8453-52fb6381961e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:27.464226 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-56804a37-23d2-40e6-8453-52fb6381961e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1732 microversion: 2.20 time: 0.440063 Jun 16 00:33:27.472122 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 347/711] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:27 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1732 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:28.488030 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-27f9839f-b4fc-48be-8066-390c23c0cf97 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:28.488659 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-27f9839f-b4fc-48be-8066-390c23c0cf97 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:28.496323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-27f9839f-b4fc-48be-8066-390c23c0cf97 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:28.497513 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-27f9839f-b4fc-48be-8066-390c23c0cf97 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:28.498979 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-27f9839f-b4fc-48be-8066-390c23c0cf97 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:28.500162 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-27f9839f-b4fc-48be-8066-390c23c0cf97 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:28.710945 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-6babe8e6-43c4-4471-9e92-9c1697de4ef2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Action: 'create', calling method: .version_select at 0x7fe704af6dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1933822337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCU1C5U6MUmfkh58NCNQR7DAy6Jch6rYCbujuabrytuig3aIyz7O+7l5KPXubN+PUU703or9Q07vUIVBK4NLWzYSpgq01Nn7rnsn0955XIkJZGsuViFfT6+ApgH85kkCxw=="}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:28.731939 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-27f9839f-b4fc-48be-8066-390c23c0cf97 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:28.745125 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-6babe8e6-43c4-4471-9e92-9c1697de4ef2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Getting quotas for project 193571b962dc4fa1aac98a6acbdc9370. Resources: {'key_pairs'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:33:28.752043 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-27f9839f-b4fc-48be-8066-390c23c0cf97 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:28.754060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-27f9839f-b4fc-48be-8066-390c23c0cf97 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:28.755629 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-27f9839f-b4fc-48be-8066-390c23c0cf97 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1732 microversion: 2.20 time: 0.271299 Jun 16 00:33:28.756811 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 348/712] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:28 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1732 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:33:28.758409 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-6babe8e6-43c4-4471-9e92-9c1697de4ef2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Getting quotas for user 728f4031df4148fe9ec9bf9ab31d25e5 and project 193571b962dc4fa1aac98a6acbdc9370. Resources: {'key_pairs'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:33:28.795357 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-6babe8e6-43c4-4471-9e92-9c1697de4ef2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.380160 Jun 16 00:33:28.796574 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 365/713] 10.222.0.23 () {60 vars in 1158 bytes} [Thu Jun 16 00:33:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:29.782975 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-0280193a-0a76-4a1b-bc50-abdb6c7f964a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:29.783592 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-0280193a-0a76-4a1b-bc50-abdb6c7f964a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:29.791322 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0280193a-0a76-4a1b-bc50-abdb6c7f964a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:29.791778 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0280193a-0a76-4a1b-bc50-abdb6c7f964a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:29.792742 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0280193a-0a76-4a1b-bc50-abdb6c7f964a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:29.793355 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0280193a-0a76-4a1b-bc50-abdb6c7f964a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:30.003303 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0280193a-0a76-4a1b-bc50-abdb6c7f964a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:30.016654 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0280193a-0a76-4a1b-bc50-abdb6c7f964a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:30.019040 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0280193a-0a76-4a1b-bc50-abdb6c7f964a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:30.020763 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-0280193a-0a76-4a1b-bc50-abdb6c7f964a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1732 microversion: 2.20 time: 0.242689 Jun 16 00:33:30.021347 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 349/714] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:29 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1732 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:31.032808 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-89ba8247-d94f-4a3a-b7e9-ed77bf82f6c7 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:31.034825 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-89ba8247-d94f-4a3a-b7e9-ed77bf82f6c7 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:31.042672 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-89ba8247-d94f-4a3a-b7e9-ed77bf82f6c7 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:31.043140 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-89ba8247-d94f-4a3a-b7e9-ed77bf82f6c7 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:31.044005 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-89ba8247-d94f-4a3a-b7e9-ed77bf82f6c7 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:31.044447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-89ba8247-d94f-4a3a-b7e9-ed77bf82f6c7 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:31.044562 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-41cfee40-11ca-402c-b783-e293592ab008 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:31.045117 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-41cfee40-11ca-402c-b783-e293592ab008 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:31.055946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-41cfee40-11ca-402c-b783-e293592ab008 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:31.056392 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-41cfee40-11ca-402c-b783-e293592ab008 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:31.057485 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-41cfee40-11ca-402c-b783-e293592ab008 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:31.058098 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-41cfee40-11ca-402c-b783-e293592ab008 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:31.092396 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-89ba8247-d94f-4a3a-b7e9-ed77bf82f6c7 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d/ips" status: 200 len: 145 microversion: 2.1 time: 0.063938 Jun 16 00:33:31.093906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 366/715] 10.222.0.23 () {58 vars in 1247 bytes} [Thu Jun 16 00:33:31 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d/ips => generated 145 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:31.238978 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-41cfee40-11ca-402c-b783-e293592ab008 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:31.247748 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-41cfee40-11ca-402c-b783-e293592ab008 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:31.249664 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-41cfee40-11ca-402c-b783-e293592ab008 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:31.251252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-41cfee40-11ca-402c-b783-e293592ab008 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1732 microversion: 2.20 time: 0.215697 Jun 16 00:33:31.252020 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 350/716] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:31 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1732 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:33:32.273317 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-5af968f6-8b8e-466a-979f-408162717eec tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:32.273317 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-5af968f6-8b8e-466a-979f-408162717eec tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:32.279651 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5af968f6-8b8e-466a-979f-408162717eec tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:32.280731 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5af968f6-8b8e-466a-979f-408162717eec tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:32.281533 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5af968f6-8b8e-466a-979f-408162717eec tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:32.281960 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5af968f6-8b8e-466a-979f-408162717eec tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:32.426581 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-5af968f6-8b8e-466a-979f-408162717eec tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:32.435143 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-5af968f6-8b8e-466a-979f-408162717eec tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:32.436767 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-5af968f6-8b8e-466a-979f-408162717eec tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:32.438010 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-5af968f6-8b8e-466a-979f-408162717eec tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1732 microversion: 2.20 time: 0.170042 Jun 16 00:33:32.438596 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 367/717] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:32 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:33.456236 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c56a7f3f-7ac5-43ad-9c1c-1224bc303620 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:33.456804 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c56a7f3f-7ac5-43ad-9c1c-1224bc303620 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:33.463487 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c56a7f3f-7ac5-43ad-9c1c-1224bc303620 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:33.464176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c56a7f3f-7ac5-43ad-9c1c-1224bc303620 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:33.465058 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c56a7f3f-7ac5-43ad-9c1c-1224bc303620 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:33.465490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c56a7f3f-7ac5-43ad-9c1c-1224bc303620 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:33.636076 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c56a7f3f-7ac5-43ad-9c1c-1224bc303620 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:33.646111 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c56a7f3f-7ac5-43ad-9c1c-1224bc303620 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:33.647846 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c56a7f3f-7ac5-43ad-9c1c-1224bc303620 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:33.649089 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c56a7f3f-7ac5-43ad-9c1c-1224bc303620 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1732 microversion: 2.20 time: 0.197392 Jun 16 00:33:33.661360 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 351/718] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:33 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1732 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:34.667663 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-824603fd-1d1e-43b9-91f9-0c49f9def1ef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:34.668311 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-824603fd-1d1e-43b9-91f9-0c49f9def1ef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:34.670817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:34.676670 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-824603fd-1d1e-43b9-91f9-0c49f9def1ef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:34.677143 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-824603fd-1d1e-43b9-91f9-0c49f9def1ef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:34.677938 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-824603fd-1d1e-43b9-91f9-0c49f9def1ef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:34.678373 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-824603fd-1d1e-43b9-91f9-0c49f9def1ef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:34.824112 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-824603fd-1d1e-43b9-91f9-0c49f9def1ef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:34.833122 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-824603fd-1d1e-43b9-91f9-0c49f9def1ef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:34.834497 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-824603fd-1d1e-43b9-91f9-0c49f9def1ef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:34.835660 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-824603fd-1d1e-43b9-91f9-0c49f9def1ef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1732 microversion: 2.20 time: 0.171999 Jun 16 00:33:34.836215 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 368/719] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:34 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:35.205975 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b5ca69ed-98fc-44a4-80a3-d375b929454a tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc09c87b-8792-4052-b91c-fc7da3717df5"}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:35.207102 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-b5ca69ed-98fc-44a4-80a3-d375b929454a tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:35.213710 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b5ca69ed-98fc-44a4-80a3-d375b929454a tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:35.214151 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b5ca69ed-98fc-44a4-80a3-d375b929454a tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:35.214897 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b5ca69ed-98fc-44a4-80a3-d375b929454a tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:35.215328 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b5ca69ed-98fc-44a4-80a3-d375b929454a tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:35.219265 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:35.464857 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-b5ca69ed-98fc-44a4-80a3-d375b929454a tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "POST /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263481 Jun 16 00:33:35.465643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 352/720] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Jun 16 00:33:35 2022] POST /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:35.855332 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-73dac64a-46cf-4905-956d-2113cc5241b6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:35.855953 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-73dac64a-46cf-4905-956d-2113cc5241b6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:35.862995 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-73dac64a-46cf-4905-956d-2113cc5241b6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:35.863475 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-73dac64a-46cf-4905-956d-2113cc5241b6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:35.864236 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-73dac64a-46cf-4905-956d-2113cc5241b6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:35.864661 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-73dac64a-46cf-4905-956d-2113cc5241b6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:36.009906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-73dac64a-46cf-4905-956d-2113cc5241b6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:36.018684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-73dac64a-46cf-4905-956d-2113cc5241b6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:36.020315 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-73dac64a-46cf-4905-956d-2113cc5241b6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:36.021647 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-73dac64a-46cf-4905-956d-2113cc5241b6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1732 microversion: 2.20 time: 0.171195 Jun 16 00:33:36.022271 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 369/721] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:35 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:37.040266 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-01a20624-903f-4f9b-b4a7-715559a888ac tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:37.040983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-01a20624-903f-4f9b-b4a7-715559a888ac tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:37.047689 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-01a20624-903f-4f9b-b4a7-715559a888ac tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:37.048175 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-01a20624-903f-4f9b-b4a7-715559a888ac tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:37.049175 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-01a20624-903f-4f9b-b4a7-715559a888ac tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:37.049620 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-01a20624-903f-4f9b-b4a7-715559a888ac tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:37.192757 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-01a20624-903f-4f9b-b4a7-715559a888ac tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:37.200943 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-01a20624-903f-4f9b-b4a7-715559a888ac tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:37.203317 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-01a20624-903f-4f9b-b4a7-715559a888ac tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:37.204614 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-01a20624-903f-4f9b-b4a7-715559a888ac tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1732 microversion: 2.20 time: 0.169005 Jun 16 00:33:37.207198 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 353/722] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:37 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:37.651022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-d53d5f25-688c-436c-bde3-ee47cf9efe38 req-01758cd5-dadc-416c-8d58-2e1c7290ea7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86b6066-9081-4634-b4da-e5c5ddd72e9d", "name": "network-vif-plugged", "status": "completed", "tag": "308b71f6-0824-4328-b466-16c67900f36f"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:37.660843 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-d53d5f25-688c-436c-bde3-ee47cf9efe38 req-01758cd5-dadc-416c-8d58-2e1c7290ea7d service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:37.661127 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-d53d5f25-688c-436c-bde3-ee47cf9efe38 req-01758cd5-dadc-416c-8d58-2e1c7290ea7d service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:37.674070 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-d53d5f25-688c-436c-bde3-ee47cf9efe38 req-01758cd5-dadc-416c-8d58-2e1c7290ea7d service nova] Creating event network-vif-plugged:308b71f6-0824-4328-b466-16c67900f36f for instance d86b6066-9081-4634-b4da-e5c5ddd72e9d on hv-cinder-84599 Jun 16 00:33:37.679345 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-d53d5f25-688c-436c-bde3-ee47cf9efe38 req-01758cd5-dadc-416c-8d58-2e1c7290ea7d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032746 Jun 16 00:33:37.679943 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 370/723] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:38.223467 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-93554461-cae5-49ff-9e07-76dd03bc99d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:38.224061 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-93554461-cae5-49ff-9e07-76dd03bc99d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:38.230642 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-93554461-cae5-49ff-9e07-76dd03bc99d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:38.231084 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-93554461-cae5-49ff-9e07-76dd03bc99d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:38.231841 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-93554461-cae5-49ff-9e07-76dd03bc99d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:38.232270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-93554461-cae5-49ff-9e07-76dd03bc99d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:38.369838 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-93554461-cae5-49ff-9e07-76dd03bc99d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:38.378292 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-93554461-cae5-49ff-9e07-76dd03bc99d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:38.379723 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-93554461-cae5-49ff-9e07-76dd03bc99d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:38.380898 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-93554461-cae5-49ff-9e07-76dd03bc99d6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1732 microversion: 2.20 time: 0.161363 Jun 16 00:33:38.381451 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 354/724] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:38 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:39.397433 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=4 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:39.401593 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-bd29cfb2-df32-4fb4-b480-569fe2a81300 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:39.402296 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-bd29cfb2-df32-4fb4-b480-569fe2a81300 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:39.409439 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-bd29cfb2-df32-4fb4-b480-569fe2a81300 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:39.409881 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-bd29cfb2-df32-4fb4-b480-569fe2a81300 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:39.410632 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-bd29cfb2-df32-4fb4-b480-569fe2a81300 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:39.411060 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-bd29cfb2-df32-4fb4-b480-569fe2a81300 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:39.550650 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-bd29cfb2-df32-4fb4-b480-569fe2a81300 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:39.559217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-bd29cfb2-df32-4fb4-b480-569fe2a81300 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:39.561037 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-bd29cfb2-df32-4fb4-b480-569fe2a81300 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:39.562373 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-bd29cfb2-df32-4fb4-b480-569fe2a81300 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1732 microversion: 2.20 time: 0.166426 Jun 16 00:33:39.562936 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 371/725] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:39 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:40.581129 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-47d97cb1-3a02-496c-a14f-1572d7344f37 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:40.581774 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-47d97cb1-3a02-496c-a14f-1572d7344f37 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:40.588477 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-47d97cb1-3a02-496c-a14f-1572d7344f37 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:40.588954 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-47d97cb1-3a02-496c-a14f-1572d7344f37 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:40.589715 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-47d97cb1-3a02-496c-a14f-1572d7344f37 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:40.590141 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-47d97cb1-3a02-496c-a14f-1572d7344f37 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:40.729680 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-47d97cb1-3a02-496c-a14f-1572d7344f37 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:40.738359 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-47d97cb1-3a02-496c-a14f-1572d7344f37 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:40.739848 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-47d97cb1-3a02-496c-a14f-1572d7344f37 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:40.741016 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-47d97cb1-3a02-496c-a14f-1572d7344f37 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1719 microversion: 2.20 time: 0.163962 Jun 16 00:33:40.741568 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 355/726] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:40 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:42.987113 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-196bdfa2-5acf-40fe-8bff-a65f6e5c999d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:42.993422 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-196bdfa2-5acf-40fe-8bff-a65f6e5c999d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:42.993868 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-196bdfa2-5acf-40fe-8bff-a65f6e5c999d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:43.056216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-196bdfa2-5acf-40fe-8bff-a65f6e5c999d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Going to try to stop instance {{(pid=124231) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 00:33:43.100315 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-196bdfa2-5acf-40fe-8bff-a65f6e5c999d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "POST /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d/action" status: 202 len: 0 microversion: 2.1 time: 0.116993 Jun 16 00:33:43.101013 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 372/727] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Jun 16 00:33:42 2022] POST /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:33:43.109302 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d7d80715-f0d9-4b01-b19a-88dea3b55e7b tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:43.110486 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d7d80715-f0d9-4b01-b19a-88dea3b55e7b tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:43.117139 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d7d80715-f0d9-4b01-b19a-88dea3b55e7b tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:43.117611 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d7d80715-f0d9-4b01-b19a-88dea3b55e7b tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:43.118485 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d7d80715-f0d9-4b01-b19a-88dea3b55e7b tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:43.118978 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d7d80715-f0d9-4b01-b19a-88dea3b55e7b tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:43.252416 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d7d80715-f0d9-4b01-b19a-88dea3b55e7b tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:43.260458 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d7d80715-f0d9-4b01-b19a-88dea3b55e7b tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1722 microversion: 2.1 time: 0.155361 Jun 16 00:33:43.261098 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 356/728] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:43 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:44.279632 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-7aec5df1-8032-4c0f-ae73-d3399553acb0 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:44.281034 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-7aec5df1-8032-4c0f-ae73-d3399553acb0 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:44.287208 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7aec5df1-8032-4c0f-ae73-d3399553acb0 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:44.287648 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7aec5df1-8032-4c0f-ae73-d3399553acb0 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:44.288396 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7aec5df1-8032-4c0f-ae73-d3399553acb0 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:44.288822 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7aec5df1-8032-4c0f-ae73-d3399553acb0 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:44.421564 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-7aec5df1-8032-4c0f-ae73-d3399553acb0 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:44.429475 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-7aec5df1-8032-4c0f-ae73-d3399553acb0 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1722 microversion: 2.1 time: 0.154498 Jun 16 00:33:44.430046 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 373/729] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:44 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:45.447188 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b55dcc35-b2d8-456d-9010-0fe09b28da28 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:45.447796 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-b55dcc35-b2d8-456d-9010-0fe09b28da28 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:45.455758 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b55dcc35-b2d8-456d-9010-0fe09b28da28 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:45.456211 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b55dcc35-b2d8-456d-9010-0fe09b28da28 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:45.457018 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b55dcc35-b2d8-456d-9010-0fe09b28da28 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:45.457452 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b55dcc35-b2d8-456d-9010-0fe09b28da28 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:45.573162 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-99318c5b-f84c-483a-bd71-a2183621bcf6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-748134431", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1933822337", "security_groups": [{"name": "tempest-secgroup-smoke-1587681135"}], "block_device_mapping_v2": [{"uuid": "7f2c6e7f-dc19-4157-9f28-a69b0dd7a97e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7336ae8f-8600-4e86-b586-ccb4abcd0dc1"}]}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:45.594979 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b55dcc35-b2d8-456d-9010-0fe09b28da28 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:45.603110 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-b55dcc35-b2d8-456d-9010-0fe09b28da28 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1722 microversion: 2.1 time: 0.160104 Jun 16 00:33:45.603683 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 357/730] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:45 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:45.686820 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.network.neutron [None req-99318c5b-f84c-483a-bd71-a2183621bcf6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] validate_networks() for [('7336ae8f-8600-4e86-b586-ccb4abcd0dc1', None, None, None, None, None)] {{(pid=124231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:33:46.044785 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-99318c5b-f84c-483a-bd71-a2183621bcf6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Flavor limits 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:33:46.045226 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-99318c5b-f84c-483a-bd71-a2183621bcf6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Image limits 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:33:46.045832 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-99318c5b-f84c-483a-bd71-a2183621bcf6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Flavor pref 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:33:46.046240 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-99318c5b-f84c-483a-bd71-a2183621bcf6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Image pref 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:33:46.046646 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-99318c5b-f84c-483a-bd71-a2183621bcf6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:33:46.055630 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-99318c5b-f84c-483a-bd71-a2183621bcf6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:46.056073 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-99318c5b-f84c-483a-bd71-a2183621bcf6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:46.056863 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-99318c5b-f84c-483a-bd71-a2183621bcf6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:46.057326 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-99318c5b-f84c-483a-bd71-a2183621bcf6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:46.073542 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-99318c5b-f84c-483a-bd71-a2183621bcf6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Getting quotas for project 193571b962dc4fa1aac98a6acbdc9370. Resources: {'ram', 'cores', 'instances'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:33:46.078068 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-99318c5b-f84c-483a-bd71-a2183621bcf6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Getting quotas for user 728f4031df4148fe9ec9bf9ab31d25e5 and project 193571b962dc4fa1aac98a6acbdc9370. Resources: {'ram', 'cores', 'instances'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:33:46.134573 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-99318c5b-f84c-483a-bd71-a2183621bcf6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Going to run 1 instances... {{(pid=124231) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:33:46.136665 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-99318c5b-f84c-483a-bd71-a2183621bcf6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f2c6e7f-dc19-4157-9f28-a69b0dd7a97e',volume_size=None,volume_type=None)] {{(pid=124231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:33:46.263599 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-99318c5b-f84c-483a-bd71-a2183621bcf6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.694336 Jun 16 00:33:46.265098 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 374/731] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Jun 16 00:33:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 00:33:46.275013 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-66612a6b-c854-4b99-93a5-90faa8c0041a tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:46.275620 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-66612a6b-c854-4b99-93a5-90faa8c0041a tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:46.329685 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-66612a6b-c854-4b99-93a5-90faa8c0041a tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:46.336586 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-66612a6b-c854-4b99-93a5-90faa8c0041a tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9" status: 200 len: 1094 microversion: 2.1 time: 0.065145 Jun 16 00:33:46.337187 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 358/732] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:46 2022] GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:46.622165 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-7d5fc01e-c267-4029-88a1-f3842518c5a5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:46.622806 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-7d5fc01e-c267-4029-88a1-f3842518c5a5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:46.629579 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7d5fc01e-c267-4029-88a1-f3842518c5a5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:46.630033 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7d5fc01e-c267-4029-88a1-f3842518c5a5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:46.630859 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7d5fc01e-c267-4029-88a1-f3842518c5a5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:46.631294 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7d5fc01e-c267-4029-88a1-f3842518c5a5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:46.771581 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-7d5fc01e-c267-4029-88a1-f3842518c5a5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:46.779602 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-7d5fc01e-c267-4029-88a1-f3842518c5a5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1722 microversion: 2.1 time: 0.162169 Jun 16 00:33:46.780789 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 375/733] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:46 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:47.353839 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-46e025ff-d2a5-445a-af7d-acc3b3e1dc3e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:47.354602 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-46e025ff-d2a5-445a-af7d-acc3b3e1dc3e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:47.363056 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-46e025ff-d2a5-445a-af7d-acc3b3e1dc3e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:47.363503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-46e025ff-d2a5-445a-af7d-acc3b3e1dc3e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:47.364271 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-46e025ff-d2a5-445a-af7d-acc3b3e1dc3e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:47.364703 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-46e025ff-d2a5-445a-af7d-acc3b3e1dc3e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:47.439906 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-46e025ff-d2a5-445a-af7d-acc3b3e1dc3e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:47.447526 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-46e025ff-d2a5-445a-af7d-acc3b3e1dc3e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9" status: 200 len: 1210 microversion: 2.1 time: 0.097515 Jun 16 00:33:47.448093 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 359/734] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:47 2022] GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:47.797722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-121cf7e3-61df-4332-a1a2-614689fb1cde tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:47.798531 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-121cf7e3-61df-4332-a1a2-614689fb1cde tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:47.805696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-121cf7e3-61df-4332-a1a2-614689fb1cde tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:47.806197 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-121cf7e3-61df-4332-a1a2-614689fb1cde tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:47.807060 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-121cf7e3-61df-4332-a1a2-614689fb1cde tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:47.807585 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-121cf7e3-61df-4332-a1a2-614689fb1cde tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:47.949392 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-121cf7e3-61df-4332-a1a2-614689fb1cde tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:47.958241 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-121cf7e3-61df-4332-a1a2-614689fb1cde tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1722 microversion: 2.1 time: 0.164343 Jun 16 00:33:47.958855 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 376/735] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:47 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:48.464537 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-54262084-8d67-4f13-951f-ba8a93a10f32 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:48.465215 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-54262084-8d67-4f13-951f-ba8a93a10f32 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:48.472387 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-54262084-8d67-4f13-951f-ba8a93a10f32 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:48.472939 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-54262084-8d67-4f13-951f-ba8a93a10f32 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:48.473773 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-54262084-8d67-4f13-951f-ba8a93a10f32 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:48.474293 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-54262084-8d67-4f13-951f-ba8a93a10f32 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:48.684002 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-54262084-8d67-4f13-951f-ba8a93a10f32 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:48.692649 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-54262084-8d67-4f13-951f-ba8a93a10f32 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9" status: 200 len: 1266 microversion: 2.1 time: 0.232079 Jun 16 00:33:48.693254 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 360/736] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:48 2022] GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:48.960185 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-9aad64f7-7484-4aea-942d-093d5084d820 req-73b94392-4489-49cd-b540-c23fe3345550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2bccd7b-433f-4329-9ab3-fceb9fc211d9", "tag": "f7b617ce-d0a8-45c4-9993-9a0d5acdc60b"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:48.974868 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-9aad64f7-7484-4aea-942d-093d5084d820 req-73b94392-4489-49cd-b540-c23fe3345550 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:48.976820 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-9aad64f7-7484-4aea-942d-093d5084d820 req-73b94392-4489-49cd-b540-c23fe3345550 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:48.976958 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-9f5f925c-3ac1-4a3d-825e-f58931a08b99 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:48.978111 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-9f5f925c-3ac1-4a3d-825e-f58931a08b99 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:48.986133 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9f5f925c-3ac1-4a3d-825e-f58931a08b99 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:48.986730 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9f5f925c-3ac1-4a3d-825e-f58931a08b99 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:48.987519 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9f5f925c-3ac1-4a3d-825e-f58931a08b99 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:48.995136 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9f5f925c-3ac1-4a3d-825e-f58931a08b99 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:49.004559 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-9aad64f7-7484-4aea-942d-093d5084d820 req-73b94392-4489-49cd-b540-c23fe3345550 service nova] Creating event network-changed:f7b617ce-d0a8-45c4-9993-9a0d5acdc60b for instance a2bccd7b-433f-4329-9ab3-fceb9fc211d9 on hv-cinder-84599 Jun 16 00:33:49.009356 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-9aad64f7-7484-4aea-942d-093d5084d820 req-73b94392-4489-49cd-b540-c23fe3345550 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052746 Jun 16 00:33:49.010196 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 377/737] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:49.216811 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-9f5f925c-3ac1-4a3d-825e-f58931a08b99 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:49.226126 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-9f5f925c-3ac1-4a3d-825e-f58931a08b99 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1722 microversion: 2.1 time: 0.254184 Jun 16 00:33:49.226702 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 361/738] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:48 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:33:49.709699 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d9bb0fef-0559-4e6e-b244-f42de40d2cc0 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:49.710314 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-d9bb0fef-0559-4e6e-b244-f42de40d2cc0 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:49.716729 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d9bb0fef-0559-4e6e-b244-f42de40d2cc0 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:49.717782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d9bb0fef-0559-4e6e-b244-f42de40d2cc0 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:49.718575 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d9bb0fef-0559-4e6e-b244-f42de40d2cc0 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:49.719260 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d9bb0fef-0559-4e6e-b244-f42de40d2cc0 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:49.850670 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d9bb0fef-0559-4e6e-b244-f42de40d2cc0 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:49.858364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-d9bb0fef-0559-4e6e-b244-f42de40d2cc0 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9" status: 200 len: 1266 microversion: 2.1 time: 0.152825 Jun 16 00:33:49.858921 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 378/739] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:49 2022] GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:50.243590 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-1cf9b347-1950-4251-bc05-6448058c573d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:50.244135 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-1cf9b347-1950-4251-bc05-6448058c573d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:50.251553 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1cf9b347-1950-4251-bc05-6448058c573d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:50.251995 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1cf9b347-1950-4251-bc05-6448058c573d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:50.252756 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1cf9b347-1950-4251-bc05-6448058c573d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:50.253216 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1cf9b347-1950-4251-bc05-6448058c573d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:50.381250 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-1cf9b347-1950-4251-bc05-6448058c573d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:50.389098 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-1cf9b347-1950-4251-bc05-6448058c573d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1722 microversion: 2.1 time: 0.149486 Jun 16 00:33:50.389658 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 362/740] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:50 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:50.874987 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-4123df1b-d27e-46ec-8827-81c6e63e0892 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:50.875594 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-4123df1b-d27e-46ec-8827-81c6e63e0892 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:50.882383 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4123df1b-d27e-46ec-8827-81c6e63e0892 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:50.882767 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4123df1b-d27e-46ec-8827-81c6e63e0892 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:50.883515 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4123df1b-d27e-46ec-8827-81c6e63e0892 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:50.883941 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4123df1b-d27e-46ec-8827-81c6e63e0892 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:51.017551 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-4123df1b-d27e-46ec-8827-81c6e63e0892 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:51.024998 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-4123df1b-d27e-46ec-8827-81c6e63e0892 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9" status: 200 len: 1266 microversion: 2.1 time: 0.153857 Jun 16 00:33:51.025562 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 379/741] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:50 2022] GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:51.406881 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-dd73a65d-eeb1-4fd2-8343-1eaf4c170ede tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:51.407490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-dd73a65d-eeb1-4fd2-8343-1eaf4c170ede tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:51.409951 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=38 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:51.415498 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-dd73a65d-eeb1-4fd2-8343-1eaf4c170ede tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:51.415950 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-dd73a65d-eeb1-4fd2-8343-1eaf4c170ede tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:51.416741 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-dd73a65d-eeb1-4fd2-8343-1eaf4c170ede tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:51.417199 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-dd73a65d-eeb1-4fd2-8343-1eaf4c170ede tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:51.547279 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-dd73a65d-eeb1-4fd2-8343-1eaf4c170ede tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:51.555387 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-dd73a65d-eeb1-4fd2-8343-1eaf4c170ede tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1722 microversion: 2.1 time: 0.152337 Jun 16 00:33:51.555961 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 363/742] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:51 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:52.042431 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-349548d1-5521-4d0c-b327-3f7c997d176e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:52.043076 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-349548d1-5521-4d0c-b327-3f7c997d176e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:52.050065 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-349548d1-5521-4d0c-b327-3f7c997d176e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:52.050502 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-349548d1-5521-4d0c-b327-3f7c997d176e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:52.051244 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-349548d1-5521-4d0c-b327-3f7c997d176e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:52.051663 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-349548d1-5521-4d0c-b327-3f7c997d176e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:52.182567 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-349548d1-5521-4d0c-b327-3f7c997d176e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:52.190430 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-349548d1-5521-4d0c-b327-3f7c997d176e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9" status: 200 len: 1266 microversion: 2.1 time: 0.151876 Jun 16 00:33:52.190993 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 380/743] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:52 2022] GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:52.572903 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-625fb374-6e7a-4648-9f03-64b9867bd4f5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:52.573557 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-625fb374-6e7a-4648-9f03-64b9867bd4f5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:52.580504 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-625fb374-6e7a-4648-9f03-64b9867bd4f5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:52.580983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-625fb374-6e7a-4648-9f03-64b9867bd4f5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:52.581737 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-625fb374-6e7a-4648-9f03-64b9867bd4f5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:52.582166 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-625fb374-6e7a-4648-9f03-64b9867bd4f5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:52.710702 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-625fb374-6e7a-4648-9f03-64b9867bd4f5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:52.719805 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-625fb374-6e7a-4648-9f03-64b9867bd4f5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1722 microversion: 2.1 time: 0.150808 Jun 16 00:33:52.720373 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 364/744] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:52 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:53.207041 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-f3c1a866-5150-43a8-a0a8-04b6c4ceb477 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:53.207640 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-f3c1a866-5150-43a8-a0a8-04b6c4ceb477 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:53.214119 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f3c1a866-5150-43a8-a0a8-04b6c4ceb477 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:53.214566 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f3c1a866-5150-43a8-a0a8-04b6c4ceb477 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:53.215317 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f3c1a866-5150-43a8-a0a8-04b6c4ceb477 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:53.215741 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f3c1a866-5150-43a8-a0a8-04b6c4ceb477 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:53.346425 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-f3c1a866-5150-43a8-a0a8-04b6c4ceb477 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:53.353736 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-f3c1a866-5150-43a8-a0a8-04b6c4ceb477 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9" status: 200 len: 1266 microversion: 2.1 time: 0.150541 Jun 16 00:33:53.354292 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 381/745] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:53 2022] GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:53.737386 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b2b877b8-deb0-4f1e-a18a-1fda976ef439 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:53.738191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-b2b877b8-deb0-4f1e-a18a-1fda976ef439 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:53.744972 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b2b877b8-deb0-4f1e-a18a-1fda976ef439 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:53.745420 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b2b877b8-deb0-4f1e-a18a-1fda976ef439 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:53.746177 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b2b877b8-deb0-4f1e-a18a-1fda976ef439 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:53.746613 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b2b877b8-deb0-4f1e-a18a-1fda976ef439 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:53.878266 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b2b877b8-deb0-4f1e-a18a-1fda976ef439 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:53.887788 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-b2b877b8-deb0-4f1e-a18a-1fda976ef439 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1722 microversion: 2.1 time: 0.154112 Jun 16 00:33:53.888367 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 365/746] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:53 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:54.371370 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-12c27b19-c7e5-43ae-b9ca-c010bcf7231e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:54.371990 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-12c27b19-c7e5-43ae-b9ca-c010bcf7231e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:54.379770 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-12c27b19-c7e5-43ae-b9ca-c010bcf7231e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:54.380222 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-12c27b19-c7e5-43ae-b9ca-c010bcf7231e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:54.381036 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-12c27b19-c7e5-43ae-b9ca-c010bcf7231e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:54.381473 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-12c27b19-c7e5-43ae-b9ca-c010bcf7231e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:54.510037 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-12c27b19-c7e5-43ae-b9ca-c010bcf7231e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:54.513613 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:54.527736 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-12c27b19-c7e5-43ae-b9ca-c010bcf7231e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9" status: 200 len: 1266 microversion: 2.1 time: 0.160386 Jun 16 00:33:54.528310 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 382/747] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:54 2022] GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:54.905527 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-a507073b-ce88-4a03-ab98-fe52edc051e2 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:54.906041 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-a507073b-ce88-4a03-ab98-fe52edc051e2 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:54.912617 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a507073b-ce88-4a03-ab98-fe52edc051e2 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:54.913106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a507073b-ce88-4a03-ab98-fe52edc051e2 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:54.913868 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a507073b-ce88-4a03-ab98-fe52edc051e2 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:54.914303 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a507073b-ce88-4a03-ab98-fe52edc051e2 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:55.041347 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a507073b-ce88-4a03-ab98-fe52edc051e2 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:55.050914 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-a507073b-ce88-4a03-ab98-fe52edc051e2 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1722 microversion: 2.1 time: 0.148584 Jun 16 00:33:55.050914 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 366/748] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:54 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:55.544636 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d4cbb314-6ca4-4677-aeef-983e61d80aa7 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:55.546291 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-d4cbb314-6ca4-4677-aeef-983e61d80aa7 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:55.554685 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d4cbb314-6ca4-4677-aeef-983e61d80aa7 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:55.555161 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d4cbb314-6ca4-4677-aeef-983e61d80aa7 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:55.555921 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d4cbb314-6ca4-4677-aeef-983e61d80aa7 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:55.556379 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d4cbb314-6ca4-4677-aeef-983e61d80aa7 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:55.688260 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d4cbb314-6ca4-4677-aeef-983e61d80aa7 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:55.695552 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-d4cbb314-6ca4-4677-aeef-983e61d80aa7 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9" status: 200 len: 1266 microversion: 2.1 time: 0.154730 Jun 16 00:33:55.696105 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 383/749] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:55 2022] GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:56.067588 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-f2b072d8-17c8-4285-a3c0-aa1c16ca1071 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:56.068188 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-f2b072d8-17c8-4285-a3c0-aa1c16ca1071 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:56.074756 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f2b072d8-17c8-4285-a3c0-aa1c16ca1071 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:56.075195 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f2b072d8-17c8-4285-a3c0-aa1c16ca1071 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:56.075936 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f2b072d8-17c8-4285-a3c0-aa1c16ca1071 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:56.076433 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f2b072d8-17c8-4285-a3c0-aa1c16ca1071 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:56.204294 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f2b072d8-17c8-4285-a3c0-aa1c16ca1071 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:56.212234 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-f2b072d8-17c8-4285-a3c0-aa1c16ca1071 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1722 microversion: 2.1 time: 0.148516 Jun 16 00:33:56.212803 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 367/750] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:56 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:56.712100 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-2b594e8d-9684-4b28-8edb-18d5d41b599b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:56.712702 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-2b594e8d-9684-4b28-8edb-18d5d41b599b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:56.714545 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=2 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:56.715203 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=6 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:56.722389 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2b594e8d-9684-4b28-8edb-18d5d41b599b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:56.722835 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2b594e8d-9684-4b28-8edb-18d5d41b599b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:56.723589 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2b594e8d-9684-4b28-8edb-18d5d41b599b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:56.724022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2b594e8d-9684-4b28-8edb-18d5d41b599b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:56.858878 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-2b594e8d-9684-4b28-8edb-18d5d41b599b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:56.866601 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-2b594e8d-9684-4b28-8edb-18d5d41b599b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9" status: 200 len: 1266 microversion: 2.1 time: 0.158510 Jun 16 00:33:56.867168 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 384/751] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:56 2022] GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:57.229042 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c174ea8f-7013-4383-b0b2-fcbe18901ef8 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:57.229649 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c174ea8f-7013-4383-b0b2-fcbe18901ef8 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:57.231449 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=2 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:57.237770 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c174ea8f-7013-4383-b0b2-fcbe18901ef8 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:57.238206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c174ea8f-7013-4383-b0b2-fcbe18901ef8 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:57.238951 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c174ea8f-7013-4383-b0b2-fcbe18901ef8 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:57.239376 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c174ea8f-7013-4383-b0b2-fcbe18901ef8 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:57.254413 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:57.371081 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c174ea8f-7013-4383-b0b2-fcbe18901ef8 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:57.379891 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c174ea8f-7013-4383-b0b2-fcbe18901ef8 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1722 microversion: 2.1 time: 0.154756 Jun 16 00:33:57.380444 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 368/752] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:57 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:57.883421 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-19678787-375c-4186-9e12-cfb3a64f1535 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:57.883954 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-19678787-375c-4186-9e12-cfb3a64f1535 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:57.891072 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-19678787-375c-4186-9e12-cfb3a64f1535 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:57.891513 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-19678787-375c-4186-9e12-cfb3a64f1535 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:57.892526 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-19678787-375c-4186-9e12-cfb3a64f1535 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:57.892974 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-19678787-375c-4186-9e12-cfb3a64f1535 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:58.022379 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-19678787-375c-4186-9e12-cfb3a64f1535 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:58.030501 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-19678787-375c-4186-9e12-cfb3a64f1535 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9" status: 200 len: 1266 microversion: 2.1 time: 0.150990 Jun 16 00:33:58.031057 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 385/753] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:57 2022] GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:58.397493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8775c6b5-be83-4519-918b-c47c442a4356 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:58.398006 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-8775c6b5-be83-4519-918b-c47c442a4356 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:58.406179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8775c6b5-be83-4519-918b-c47c442a4356 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:58.406627 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8775c6b5-be83-4519-918b-c47c442a4356 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:58.407383 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8775c6b5-be83-4519-918b-c47c442a4356 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:58.407812 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8775c6b5-be83-4519-918b-c47c442a4356 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:58.542011 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-8775c6b5-be83-4519-918b-c47c442a4356 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:58.550672 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-8775c6b5-be83-4519-918b-c47c442a4356 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1722 microversion: 2.1 time: 0.157077 Jun 16 00:33:58.551230 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 369/754] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:58 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:59.047531 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-74496210-2746-46f8-a18c-337e160c8a6f tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:59.048052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-74496210-2746-46f8-a18c-337e160c8a6f tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:59.054493 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-74496210-2746-46f8-a18c-337e160c8a6f tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:59.054933 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-74496210-2746-46f8-a18c-337e160c8a6f tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:59.055685 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-74496210-2746-46f8-a18c-337e160c8a6f tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:59.056108 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-74496210-2746-46f8-a18c-337e160c8a6f tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:59.186125 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-74496210-2746-46f8-a18c-337e160c8a6f tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:59.193542 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-74496210-2746-46f8-a18c-337e160c8a6f tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9" status: 200 len: 1266 microversion: 2.1 time: 0.150727 Jun 16 00:33:59.194109 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 386/755] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:59 2022] GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:59.567290 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-fe77ffbf-823e-498a-bba9-d49a296aa418 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:59.567890 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-fe77ffbf-823e-498a-bba9-d49a296aa418 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:59.575387 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fe77ffbf-823e-498a-bba9-d49a296aa418 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:59.576341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fe77ffbf-823e-498a-bba9-d49a296aa418 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:59.577220 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fe77ffbf-823e-498a-bba9-d49a296aa418 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:59.577651 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fe77ffbf-823e-498a-bba9-d49a296aa418 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:59.719773 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-fe77ffbf-823e-498a-bba9-d49a296aa418 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:59.728983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-fe77ffbf-823e-498a-bba9-d49a296aa418 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1699 microversion: 2.1 time: 0.164972 Jun 16 00:33:59.740075 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 370/756] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:59 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1699 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:59.745601 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-0431e5cb-e55b-4b86-a8ea-832c5144ee47 req-40ca786e-3d6a-452b-83c7-ebf2cb0cbbda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2bccd7b-433f-4329-9ab3-fceb9fc211d9", "name": "network-vif-plugged", "status": "completed", "tag": "f7b617ce-d0a8-45c4-9993-9a0d5acdc60b"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:59.746540 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-176b7230-ac97-488a-83da-a1dfe668c4b2 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:59.754642 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-176b7230-ac97-488a-83da-a1dfe668c4b2 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:59.755220 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-176b7230-ac97-488a-83da-a1dfe668c4b2 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:59.755675 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-0431e5cb-e55b-4b86-a8ea-832c5144ee47 req-40ca786e-3d6a-452b-83c7-ebf2cb0cbbda service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:59.756116 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-0431e5cb-e55b-4b86-a8ea-832c5144ee47 req-40ca786e-3d6a-452b-83c7-ebf2cb0cbbda service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:59.768748 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-0431e5cb-e55b-4b86-a8ea-832c5144ee47 req-40ca786e-3d6a-452b-83c7-ebf2cb0cbbda service nova] Creating event network-vif-plugged:f7b617ce-d0a8-45c4-9993-9a0d5acdc60b for instance a2bccd7b-433f-4329-9ab3-fceb9fc211d9 on hv-cinder-84599 Jun 16 00:33:59.773765 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-0431e5cb-e55b-4b86-a8ea-832c5144ee47 req-40ca786e-3d6a-452b-83c7-ebf2cb0cbbda service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032016 Jun 16 00:33:59.774451 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 387/757] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:59.821321 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-176b7230-ac97-488a-83da-a1dfe668c4b2 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Going to try to start instance {{(pid=124230) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 00:33:59.864376 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-176b7230-ac97-488a-83da-a1dfe668c4b2 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "POST /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d/action" status: 202 len: 0 microversion: 2.1 time: 0.122312 Jun 16 00:33:59.865036 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 371/758] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Jun 16 00:33:59 2022] POST /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:33:59.873961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-04b8c234-f58e-4a8a-84a3-fb2d1b08ec60 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:59.874747 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-04b8c234-f58e-4a8a-84a3-fb2d1b08ec60 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:59.881266 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-04b8c234-f58e-4a8a-84a3-fb2d1b08ec60 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:59.881709 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-04b8c234-f58e-4a8a-84a3-fb2d1b08ec60 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:59.882462 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-04b8c234-f58e-4a8a-84a3-fb2d1b08ec60 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:59.882887 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-04b8c234-f58e-4a8a-84a3-fb2d1b08ec60 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:00.040619 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-04b8c234-f58e-4a8a-84a3-fb2d1b08ec60 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:00.052178 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-04b8c234-f58e-4a8a-84a3-fb2d1b08ec60 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1708 microversion: 2.1 time: 0.182808 Jun 16 00:34:00.063032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 388/759] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:59 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1708 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:00.210840 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-4a3948ba-305d-4388-bd01-2fced619a470 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:00.211570 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-4a3948ba-305d-4388-bd01-2fced619a470 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:00.217830 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4a3948ba-305d-4388-bd01-2fced619a470 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:00.218291 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4a3948ba-305d-4388-bd01-2fced619a470 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:00.219044 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4a3948ba-305d-4388-bd01-2fced619a470 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:00.219479 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4a3948ba-305d-4388-bd01-2fced619a470 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:00.356635 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-4a3948ba-305d-4388-bd01-2fced619a470 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:00.365365 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-4a3948ba-305d-4388-bd01-2fced619a470 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9" status: 200 len: 1266 microversion: 2.1 time: 0.158786 Jun 16 00:34:00.365937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 372/760] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:00 2022] GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:01.070727 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-e6d76631-3281-4123-9c46-f7f1a96d8a30 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:01.071372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-e6d76631-3281-4123-9c46-f7f1a96d8a30 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:01.078636 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e6d76631-3281-4123-9c46-f7f1a96d8a30 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:01.079089 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e6d76631-3281-4123-9c46-f7f1a96d8a30 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:01.079848 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e6d76631-3281-4123-9c46-f7f1a96d8a30 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:01.080289 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e6d76631-3281-4123-9c46-f7f1a96d8a30 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:01.213462 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-e6d76631-3281-4123-9c46-f7f1a96d8a30 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:01.221441 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-e6d76631-3281-4123-9c46-f7f1a96d8a30 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1708 microversion: 2.1 time: 0.154660 Jun 16 00:34:01.222004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 389/761] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:01 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1708 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:01.382883 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c596a82e-b47b-4a4a-a696-628218612dfa tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:01.383484 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c596a82e-b47b-4a4a-a696-628218612dfa tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:01.390011 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c596a82e-b47b-4a4a-a696-628218612dfa tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:01.390448 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c596a82e-b47b-4a4a-a696-628218612dfa tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:01.391187 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c596a82e-b47b-4a4a-a696-628218612dfa tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:01.392075 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c596a82e-b47b-4a4a-a696-628218612dfa tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:01.527521 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c596a82e-b47b-4a4a-a696-628218612dfa tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:01.535600 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c596a82e-b47b-4a4a-a696-628218612dfa tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9" status: 200 len: 1266 microversion: 2.1 time: 0.156489 Jun 16 00:34:01.536155 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 373/762] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:01 2022] GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:02.238730 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-6ef48c8d-a0dc-4a68-a392-b24af130caf6 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:02.239334 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-6ef48c8d-a0dc-4a68-a392-b24af130caf6 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:02.245764 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6ef48c8d-a0dc-4a68-a392-b24af130caf6 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:02.246200 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6ef48c8d-a0dc-4a68-a392-b24af130caf6 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:02.246941 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6ef48c8d-a0dc-4a68-a392-b24af130caf6 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:02.247365 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6ef48c8d-a0dc-4a68-a392-b24af130caf6 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:02.375238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-6ef48c8d-a0dc-4a68-a392-b24af130caf6 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:02.383031 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-6ef48c8d-a0dc-4a68-a392-b24af130caf6 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1708 microversion: 2.1 time: 0.148081 Jun 16 00:34:02.383586 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 390/763] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:02 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1708 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:02.552705 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-39c982e5-8ca5-4961-8d56-bc47ab0a3a6b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:02.553360 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-39c982e5-8ca5-4961-8d56-bc47ab0a3a6b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:02.559830 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-39c982e5-8ca5-4961-8d56-bc47ab0a3a6b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:02.561567 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-39c982e5-8ca5-4961-8d56-bc47ab0a3a6b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:02.562328 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-39c982e5-8ca5-4961-8d56-bc47ab0a3a6b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:02.562759 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-39c982e5-8ca5-4961-8d56-bc47ab0a3a6b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:02.699849 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-39c982e5-8ca5-4961-8d56-bc47ab0a3a6b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:02.707787 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-39c982e5-8ca5-4961-8d56-bc47ab0a3a6b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9" status: 200 len: 1453 microversion: 2.1 time: 0.158920 Jun 16 00:34:02.708388 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 374/764] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:02 2022] GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:02.724565 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-591417bf-e02b-4266-a654-be23e7dd329b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:02.725193 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-591417bf-e02b-4266-a654-be23e7dd329b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:02.731581 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-591417bf-e02b-4266-a654-be23e7dd329b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:02.732631 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-591417bf-e02b-4266-a654-be23e7dd329b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:02.733423 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-591417bf-e02b-4266-a654-be23e7dd329b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:02.733844 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-591417bf-e02b-4266-a654-be23e7dd329b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:02.885817 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-7ab88821-255f-4151-8104-5c71239c87fa tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:02.886453 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-7ab88821-255f-4151-8104-5c71239c87fa tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:02.887350 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-591417bf-e02b-4266-a654-be23e7dd329b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:02.892841 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7ab88821-255f-4151-8104-5c71239c87fa tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:02.893322 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7ab88821-255f-4151-8104-5c71239c87fa tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:02.894084 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7ab88821-255f-4151-8104-5c71239c87fa tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:02.894557 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7ab88821-255f-4151-8104-5c71239c87fa tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:02.895160 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-591417bf-e02b-4266-a654-be23e7dd329b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9" status: 200 len: 1453 microversion: 2.1 time: 0.174365 Jun 16 00:34:02.895726 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 391/765] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:02 2022] GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:02.918934 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-7ab88821-255f-4151-8104-5c71239c87fa tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065/ips" status: 200 len: 149 microversion: 2.1 time: 0.159477 Jun 16 00:34:02.919552 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 375/766] 10.222.0.23 () {58 vars in 1247 bytes} [Thu Jun 16 00:34:02 2022] GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065/ips => generated 149 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:34:03.400039 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-2b46be26-56ce-47a5-9b1e-b03e3a7b179e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:03.400632 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-2b46be26-56ce-47a5-9b1e-b03e3a7b179e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:03.407508 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2b46be26-56ce-47a5-9b1e-b03e3a7b179e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:03.407952 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2b46be26-56ce-47a5-9b1e-b03e3a7b179e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:03.408698 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2b46be26-56ce-47a5-9b1e-b03e3a7b179e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:03.409143 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2b46be26-56ce-47a5-9b1e-b03e3a7b179e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:03.542071 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-2b46be26-56ce-47a5-9b1e-b03e3a7b179e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:03.552014 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-2b46be26-56ce-47a5-9b1e-b03e3a7b179e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1712 microversion: 2.1 time: 0.155816 Jun 16 00:34:03.552594 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 392/767] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:03 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1712 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:04.257715 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-815c5fd3-182c-481f-acf8-a91388ecff1b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "519bd858-a334-4a07-9b50-a0d43b57deab"}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:34:04.258883 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-815c5fd3-182c-481f-acf8-a91388ecff1b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:04.267407 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-815c5fd3-182c-481f-acf8-a91388ecff1b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:04.267855 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-815c5fd3-182c-481f-acf8-a91388ecff1b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:04.268627 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-815c5fd3-182c-481f-acf8-a91388ecff1b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:04.269088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-815c5fd3-182c-481f-acf8-a91388ecff1b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:04.520017 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-815c5fd3-182c-481f-acf8-a91388ecff1b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "POST /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266107 Jun 16 00:34:04.520821 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 376/768] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Jun 16 00:34:04 2022] POST /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:04.625522 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-e078a55c-3d6e-4459-8fc9-dc4638e442bf req-6361c868-31fe-47d5-a09b-44512aba51d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2bccd7b-433f-4329-9ab3-fceb9fc211d9", "tag": "f7b617ce-d0a8-45c4-9993-9a0d5acdc60b"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:34:04.634288 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-e078a55c-3d6e-4459-8fc9-dc4638e442bf req-6361c868-31fe-47d5-a09b-44512aba51d9 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:04.634908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-e078a55c-3d6e-4459-8fc9-dc4638e442bf req-6361c868-31fe-47d5-a09b-44512aba51d9 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:04.647357 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-e078a55c-3d6e-4459-8fc9-dc4638e442bf req-6361c868-31fe-47d5-a09b-44512aba51d9 service nova] Creating event network-changed:f7b617ce-d0a8-45c4-9993-9a0d5acdc60b for instance a2bccd7b-433f-4329-9ab3-fceb9fc211d9 on hv-cinder-84599 Jun 16 00:34:04.653114 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-e078a55c-3d6e-4459-8fc9-dc4638e442bf req-6361c868-31fe-47d5-a09b-44512aba51d9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031991 Jun 16 00:34:04.654217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 393/769] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:34:12.105764 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-2e6dcd73-d31d-4f6d-be0b-e9ee27a6b30d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:12.106347 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-2e6dcd73-d31d-4f6d-be0b-e9ee27a6b30d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:12.113481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2e6dcd73-d31d-4f6d-be0b-e9ee27a6b30d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:12.113928 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2e6dcd73-d31d-4f6d-be0b-e9ee27a6b30d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:12.114687 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2e6dcd73-d31d-4f6d-be0b-e9ee27a6b30d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:12.115121 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2e6dcd73-d31d-4f6d-be0b-e9ee27a6b30d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:12.196808 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.objects.instance [None req-2e6dcd73-d31d-4f6d-be0b-e9ee27a6b30d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lazy-loading 'services' on Instance uuid a4f4cf51-b32f-46a8-9829-d4365ec4d065 {{(pid=124230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:34:12.270199 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-2e6dcd73-d31d-4f6d-be0b-e9ee27a6b30d tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065/os-volume_attachments/519bd858-a334-4a07-9b50-a0d43b57deab" status: 202 len: 0 microversion: 2.1 time: 0.168512 Jun 16 00:34:12.270786 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 377/770] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Jun 16 00:34:12 2022] DELETE /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065/os-volume_attachments/519bd858-a334-4a07-9b50-a0d43b57deab => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:34:12.280323 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-e24830bb-881c-49c2-8bf3-02315ea272e0 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:12.282022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-e24830bb-881c-49c2-8bf3-02315ea272e0 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:12.284071 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:12.289734 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e24830bb-881c-49c2-8bf3-02315ea272e0 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:12.290179 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e24830bb-881c-49c2-8bf3-02315ea272e0 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:12.290936 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e24830bb-881c-49c2-8bf3-02315ea272e0 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:12.291365 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e24830bb-881c-49c2-8bf3-02315ea272e0 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:12.322512 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-e24830bb-881c-49c2-8bf3-02315ea272e0 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047189 Jun 16 00:34:12.323063 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 394/771] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Jun 16 00:34:12 2022] GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:13.335304 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-237e3678-9f6b-41cf-8d5d-0983ae58cfeb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:13.337067 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-237e3678-9f6b-41cf-8d5d-0983ae58cfeb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:13.344510 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-237e3678-9f6b-41cf-8d5d-0983ae58cfeb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:13.345009 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-237e3678-9f6b-41cf-8d5d-0983ae58cfeb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:13.345781 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-237e3678-9f6b-41cf-8d5d-0983ae58cfeb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:13.346209 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-237e3678-9f6b-41cf-8d5d-0983ae58cfeb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:13.377125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-237e3678-9f6b-41cf-8d5d-0983ae58cfeb tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046022 Jun 16 00:34:13.377695 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 378/772] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Jun 16 00:34:13 2022] GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:34:13.434605 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-8417ec03-77f7-4432-b099-74bb6c848698 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:13.435118 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-8417ec03-77f7-4432-b099-74bb6c848698 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:13.442177 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8417ec03-77f7-4432-b099-74bb6c848698 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:13.442620 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8417ec03-77f7-4432-b099-74bb6c848698 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:13.443404 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8417ec03-77f7-4432-b099-74bb6c848698 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:13.443832 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8417ec03-77f7-4432-b099-74bb6c848698 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:13.469024 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-8417ec03-77f7-4432-b099-74bb6c848698 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Going to try to terminate instance {{(pid=124231) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:34:13.542601 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-8417ec03-77f7-4432-b099-74bb6c848698 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065" status: 204 len: 0 microversion: 2.1 time: 0.111586 Jun 16 00:34:13.543093 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 395/773] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:34:13 2022] DELETE /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:34:13.551745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-7e93e34a-d786-465c-848b-c8b440dac937 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:13.552442 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-7e93e34a-d786-465c-848b-c8b440dac937 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:13.559276 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7e93e34a-d786-465c-848b-c8b440dac937 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:13.559709 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7e93e34a-d786-465c-848b-c8b440dac937 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:13.560478 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7e93e34a-d786-465c-848b-c8b440dac937 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:13.560918 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7e93e34a-d786-465c-848b-c8b440dac937 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:13.695240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-7e93e34a-d786-465c-848b-c8b440dac937 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:13.702725 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-7e93e34a-d786-465c-848b-c8b440dac937 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065" status: 200 len: 1679 microversion: 2.1 time: 0.154844 Jun 16 00:34:13.703353 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 379/774] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:13 2022] GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:14.720453 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-e0ef946a-0d69-458c-a365-b73ec42eec28 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:14.721200 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-e0ef946a-0d69-458c-a365-b73ec42eec28 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:14.728207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e0ef946a-0d69-458c-a365-b73ec42eec28 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:14.728646 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e0ef946a-0d69-458c-a365-b73ec42eec28 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:14.729423 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e0ef946a-0d69-458c-a365-b73ec42eec28 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:14.729855 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e0ef946a-0d69-458c-a365-b73ec42eec28 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:14.862554 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-e0ef946a-0d69-458c-a365-b73ec42eec28 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:14.869949 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-e0ef946a-0d69-458c-a365-b73ec42eec28 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065" status: 200 len: 1679 microversion: 2.1 time: 0.153797 Jun 16 00:34:14.870508 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 396/775] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:14 2022] GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:15.887385 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c1b2d0d3-bd7a-49ad-aa23-25a29abea468 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:15.887988 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c1b2d0d3-bd7a-49ad-aa23-25a29abea468 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:15.895769 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c1b2d0d3-bd7a-49ad-aa23-25a29abea468 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:15.896213 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c1b2d0d3-bd7a-49ad-aa23-25a29abea468 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:15.896984 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c1b2d0d3-bd7a-49ad-aa23-25a29abea468 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:15.897411 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c1b2d0d3-bd7a-49ad-aa23-25a29abea468 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:15.962085 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c1b2d0d3-bd7a-49ad-aa23-25a29abea468 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535a03ce19d346d59e6a6f6befb9dea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5d56c0c6444b23a1ac6cc2fcb0bb52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:15.970337 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c1b2d0d3-bd7a-49ad-aa23-25a29abea468 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065" status: 200 len: 1613 microversion: 2.1 time: 0.086767 Jun 16 00:34:15.970917 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 380/776] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:15 2022] GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065 => generated 1613 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:16.138990 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-4e02fafb-884d-4109-964d-34b8b485d719 req-fc88fe23-9410-4b9c-9571-4cd5575571d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4f4cf51-b32f-46a8-9829-d4365ec4d065", "name": "network-vif-deleted", "tag": "7d000d19-ae48-45c1-9193-30611893d3b3"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:34:16.148818 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-4e02fafb-884d-4109-964d-34b8b485d719 req-fc88fe23-9410-4b9c-9571-4cd5575571d7 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:16.149281 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-4e02fafb-884d-4109-964d-34b8b485d719 req-fc88fe23-9410-4b9c-9571-4cd5575571d7 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:16.160550 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-4e02fafb-884d-4109-964d-34b8b485d719 req-fc88fe23-9410-4b9c-9571-4cd5575571d7 service nova] Creating event network-vif-deleted:7d000d19-ae48-45c1-9193-30611893d3b3 for instance a4f4cf51-b32f-46a8-9829-d4365ec4d065 on hv-cinder-84599 Jun 16 00:34:16.166336 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-4e02fafb-884d-4109-964d-34b8b485d719 req-fc88fe23-9410-4b9c-9571-4cd5575571d7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030885 Jun 16 00:34:16.168499 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 397/777] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:16.987273 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5dd21d57-566a-4e5a-99f1-5d1f6f227ae3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:16.987884 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-5dd21d57-566a-4e5a-99f1-5d1f6f227ae3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:16.994413 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5dd21d57-566a-4e5a-99f1-5d1f6f227ae3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:16.994858 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5dd21d57-566a-4e5a-99f1-5d1f6f227ae3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:16.995616 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5dd21d57-566a-4e5a-99f1-5d1f6f227ae3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:16.996048 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5dd21d57-566a-4e5a-99f1-5d1f6f227ae3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:17.010146 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-5dd21d57-566a-4e5a-99f1-5d1f6f227ae3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] HTTP exception thrown: Instance a4f4cf51-b32f-46a8-9829-d4365ec4d065 could not be found. Jun 16 00:34:17.011760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5dd21d57-566a-4e5a-99f1-5d1f6f227ae3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Request method failure captured: Jun 16 00:34:17.011760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065 HTTP/1.1 Jun 16 00:34:17.011760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:34:17.011760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:34:17.011760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:34:17.011760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:34:17.011760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:34:17.011760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:34:17.011760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:34:17.011760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:17.011760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnlEQtlTYlcSb6Cxq7ka8JkFDrXY9ZTyYkOKl7RMv-Nc50AOOLvvYPcyo-002Bp2d50a3LSSgJspVILfxuCarFtF9OBY195yuIkdM0DVC_olTUnFngMBTQdDXeOL4IjwWYA5CoVYPq-YWQwNW1R5R2mbX6MVy2x9qf1Ysp-JTmbE9Gk Jun 16 00:34:17.011760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:34:17.011760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:34:17.011760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:34:17.011760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:34:17.011760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:34:17.011760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:34:17.011760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:34:17.011760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:17.011760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:34:17.011760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:34:17.013298 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:34:17.013298 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:17.013298 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:34:17.013298 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:17.013298 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:34:17.013298 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:34:17.013298 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:34:17.013298 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: 535a03ce19d346d59e6a6f6befb9dea0 Jun 16 00:34:17.013298 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:34:17.013298 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: > Jun 16 00:34:17.013298 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Instance a4f4cf51-b32f-46a8-9829-d4365ec4d065 could not be found. Jun 16 00:34:17.013298 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'id': 'a4f4cf51-b32f-46a8-9829-d4365ec4d065'} Jun 16 00:34:17.014060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:17.014060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:17.014060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:34:17.014060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:34:17.014060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:34:17.014060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:34:17.014060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:34:17.014060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:34:17.014060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:34:17.014060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:34:17.014060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4f4cf51-b32f-46a8-9829-d4365ec4d065 could not be found. Jun 16 00:34:17.014060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:17.014060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:17.014060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:17.014060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:17.014060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:17.014060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:17.014060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:17.014060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:17.014060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:17.016106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:17.016106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:34:17.016106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:34:17.016106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:34:17.016106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:34:17.016106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:34:17.016106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:34:17.016106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4f4cf51-b32f-46a8-9829-d4365ec4d065 could not be found. Jun 16 00:34:17.016106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:17.016106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:17.016106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:17.016106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:17.016106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:17.016106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:17.016106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:34:17.016106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:34:17.016106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4f4cf51-b32f-46a8-9829-d4365ec4d065 could not be found. Jun 16 00:34:17.016106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:17.017553 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5dd21d57-566a-4e5a-99f1-5d1f6f227ae3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Returning 404 to user: Instance a4f4cf51-b32f-46a8-9829-d4365ec4d065 could not be found. {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:17.017553 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-5dd21d57-566a-4e5a-99f1-5d1f6f227ae3 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065" status: 404 len: 111 microversion: 2.1 time: 0.029992 Jun 16 00:34:17.017553 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 381/778] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:16 2022] GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:34:17.023414 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b12dc2bf-13f9-4a9a-8a74-7e79c66c092b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '.version_select at 0x7fe704a3eca0>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:17.041659 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-b12dc2bf-13f9-4a9a-8a74-7e79c66c092b tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1746506704" status: 202 len: 0 microversion: 2.1 time: 0.022309 Jun 16 00:34:17.042349 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 398/779] 10.222.0.23 () {58 vars in 1220 bytes} [Thu Jun 16 00:34:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1746506704 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:34:19.027963 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-e730c3db-daa8-4657-af32-1c77d8f05535 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:19.028453 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-e730c3db-daa8-4657-af32-1c77d8f05535 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:19.036092 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e730c3db-daa8-4657-af32-1c77d8f05535 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:19.036530 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e730c3db-daa8-4657-af32-1c77d8f05535 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:19.037309 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e730c3db-daa8-4657-af32-1c77d8f05535 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:19.037736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e730c3db-daa8-4657-af32-1c77d8f05535 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:19.051062 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-e730c3db-daa8-4657-af32-1c77d8f05535 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] HTTP exception thrown: Instance a4f4cf51-b32f-46a8-9829-d4365ec4d065 could not be found. Jun 16 00:34:19.052556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-e730c3db-daa8-4657-af32-1c77d8f05535 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Request method failure captured: Jun 16 00:34:19.052556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: DELETE /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065 HTTP/1.1 Jun 16 00:34:19.052556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:34:19.052556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:34:19.052556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:34:19.052556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:34:19.052556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:34:19.052556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:34:19.052556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:34:19.052556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:19.052556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnlEQtlTYlcSb6Cxq7ka8JkFDrXY9ZTyYkOKl7RMv-Nc50AOOLvvYPcyo-002Bp2d50a3LSSgJspVILfxuCarFtF9OBY195yuIkdM0DVC_olTUnFngMBTQdDXeOL4IjwWYA5CoVYPq-YWQwNW1R5R2mbX6MVy2x9qf1Ysp-JTmbE9Gk Jun 16 00:34:19.052556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:34:19.052556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:34:19.052556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:34:19.052556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:34:19.052556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:34:19.052556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:34:19.052556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:34:19.052556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:19.052556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:34:19.052556 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:34:19.054113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:34:19.054113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:19.054113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:34:19.054113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:19.054113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:34:19.054113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:34:19.054113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:34:19.054113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: 535a03ce19d346d59e6a6f6befb9dea0 Jun 16 00:34:19.054113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:34:19.054113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: > Jun 16 00:34:19.054113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Instance a4f4cf51-b32f-46a8-9829-d4365ec4d065 could not be found. Jun 16 00:34:19.054113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'id': 'a4f4cf51-b32f-46a8-9829-d4365ec4d065'} Jun 16 00:34:19.054919 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:19.054919 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:19.054919 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:34:19.054919 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:34:19.054919 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:34:19.054919 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:34:19.054919 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:34:19.054919 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:34:19.054919 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:34:19.054919 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:34:19.054919 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4f4cf51-b32f-46a8-9829-d4365ec4d065 could not be found. Jun 16 00:34:19.054919 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:19.054919 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:19.054919 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:19.054919 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:19.054919 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:19.054919 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:19.054919 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:19.054919 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:19.054919 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:19.056082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:19.056082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:34:19.056082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:34:19.056082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:34:19.056082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:34:19.056082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:34:19.056082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:34:19.056082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:34:19.056082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:34:19.056082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4f4cf51-b32f-46a8-9829-d4365ec4d065 could not be found. Jun 16 00:34:19.056082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:19.056082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:19.056082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:19.056082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:19.056082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:19.056082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:19.056082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:34:19.056082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:34:19.056082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4f4cf51-b32f-46a8-9829-d4365ec4d065 could not be found. Jun 16 00:34:19.056082 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:19.057273 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-e730c3db-daa8-4657-af32-1c77d8f05535 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Returning 404 to user: Instance a4f4cf51-b32f-46a8-9829-d4365ec4d065 could not be found. {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:19.057273 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-e730c3db-daa8-4657-af32-1c77d8f05535 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065" status: 404 len: 111 microversion: 2.1 time: 0.029686 Jun 16 00:34:19.057273 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 382/780] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:34:19 2022] DELETE /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:34:19.063415 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-da4a2f8a-8a91-4528-87ae-3e7b2c1c0506 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:19.064134 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-da4a2f8a-8a91-4528-87ae-3e7b2c1c0506 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: a4f4cf51-b32f-46a8-9829-d4365ec4d065] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:19.070231 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-da4a2f8a-8a91-4528-87ae-3e7b2c1c0506 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:19.070672 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-da4a2f8a-8a91-4528-87ae-3e7b2c1c0506 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:19.071407 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-da4a2f8a-8a91-4528-87ae-3e7b2c1c0506 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:19.071832 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-da4a2f8a-8a91-4528-87ae-3e7b2c1c0506 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:19.085625 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-da4a2f8a-8a91-4528-87ae-3e7b2c1c0506 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] HTTP exception thrown: Instance a4f4cf51-b32f-46a8-9829-d4365ec4d065 could not be found. Jun 16 00:34:19.087174 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-da4a2f8a-8a91-4528-87ae-3e7b2c1c0506 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Request method failure captured: Jun 16 00:34:19.087174 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065 HTTP/1.1 Jun 16 00:34:19.087174 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:34:19.087174 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:34:19.087174 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:34:19.087174 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:34:19.087174 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:34:19.087174 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:34:19.087174 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:34:19.087174 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:19.087174 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnlEQtlTYlcSb6Cxq7ka8JkFDrXY9ZTyYkOKl7RMv-Nc50AOOLvvYPcyo-002Bp2d50a3LSSgJspVILfxuCarFtF9OBY195yuIkdM0DVC_olTUnFngMBTQdDXeOL4IjwWYA5CoVYPq-YWQwNW1R5R2mbX6MVy2x9qf1Ysp-JTmbE9Gk Jun 16 00:34:19.087174 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:34:19.087174 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:34:19.087174 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:34:19.087174 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:34:19.087174 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:34:19.087174 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:34:19.087174 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:34:19.087174 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:19.087174 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:34:19.087174 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:34:19.088743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:34:19.088743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:19.088743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:34:19.088743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:19.088743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:34:19.088743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:34:19.088743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:34:19.088743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: 535a03ce19d346d59e6a6f6befb9dea0 Jun 16 00:34:19.088743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:34:19.088743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:34:19.088743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Instance a4f4cf51-b32f-46a8-9829-d4365ec4d065 could not be found. Jun 16 00:34:19.088743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': 'a4f4cf51-b32f-46a8-9829-d4365ec4d065'} Jun 16 00:34:19.089684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:19.089684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:19.089684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:34:19.089684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:34:19.089684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:34:19.089684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:34:19.089684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:34:19.089684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:34:19.089684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:34:19.089684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:34:19.089684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4f4cf51-b32f-46a8-9829-d4365ec4d065 could not be found. Jun 16 00:34:19.089684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:19.089684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:19.089684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:19.089684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:19.089684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:19.089684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:19.089684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:19.089684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:19.089684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:19.091145 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:19.091145 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:34:19.091145 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:34:19.091145 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:34:19.091145 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:34:19.091145 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:34:19.091145 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:34:19.091145 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4f4cf51-b32f-46a8-9829-d4365ec4d065 could not be found. Jun 16 00:34:19.091145 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:19.091145 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:19.091145 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:19.091145 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:19.091145 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:19.091145 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:19.091145 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:34:19.091145 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:34:19.091145 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4f4cf51-b32f-46a8-9829-d4365ec4d065 could not be found. Jun 16 00:34:19.091145 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:19.092442 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-da4a2f8a-8a91-4528-87ae-3e7b2c1c0506 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Returning 404 to user: Instance a4f4cf51-b32f-46a8-9829-d4365ec4d065 could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:19.092442 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-da4a2f8a-8a91-4528-87ae-3e7b2c1c0506 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065" status: 404 len: 111 microversion: 2.1 time: 0.030159 Jun 16 00:34:19.092442 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 399/781] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:19 2022] GET /compute/v2.1/servers/a4f4cf51-b32f-46a8-9829-d4365ec4d065 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:34:19.205476 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-2ca99ddc-95f9-4cc9-860f-5fee89beeeef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:19.206448 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-2ca99ddc-95f9-4cc9-860f-5fee89beeeef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:19.212708 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2ca99ddc-95f9-4cc9-860f-5fee89beeeef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:19.213198 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2ca99ddc-95f9-4cc9-860f-5fee89beeeef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:19.213959 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2ca99ddc-95f9-4cc9-860f-5fee89beeeef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:19.214399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2ca99ddc-95f9-4cc9-860f-5fee89beeeef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:19.238739 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:19.243578 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-2ca99ddc-95f9-4cc9-860f-5fee89beeeef tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042928 Jun 16 00:34:19.244125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 383/782] 10.222.0.23 () {60 vars in 1342 bytes} [Thu Jun 16 00:34:19 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:19.301024 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-e9232bae-c154-441e-adf4-50bf81f20997 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:19.301524 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-e9232bae-c154-441e-adf4-50bf81f20997 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:19.307423 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e9232bae-c154-441e-adf4-50bf81f20997 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:19.307883 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e9232bae-c154-441e-adf4-50bf81f20997 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:19.308652 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e9232bae-c154-441e-adf4-50bf81f20997 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:19.309109 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e9232bae-c154-441e-adf4-50bf81f20997 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:19.338027 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-e9232bae-c154-441e-adf4-50bf81f20997 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Going to try to terminate instance {{(pid=124231) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:34:19.361591 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:19.416500 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-e9232bae-c154-441e-adf4-50bf81f20997 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 204 len: 0 microversion: 2.20 time: 0.119000 Jun 16 00:34:19.417474 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 400/783] 10.222.0.23 () {60 vars in 1279 bytes} [Thu Jun 16 00:34:19 2022] DELETE /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 00:34:19.426237 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-3f3017cb-fb14-459f-8ada-40136d48fda6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:19.426876 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-3f3017cb-fb14-459f-8ada-40136d48fda6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:19.433548 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3f3017cb-fb14-459f-8ada-40136d48fda6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:19.433996 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3f3017cb-fb14-459f-8ada-40136d48fda6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:19.434747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3f3017cb-fb14-459f-8ada-40136d48fda6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:19.435178 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3f3017cb-fb14-459f-8ada-40136d48fda6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:19.561790 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-3f3017cb-fb14-459f-8ada-40136d48fda6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:19.570274 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-3f3017cb-fb14-459f-8ada-40136d48fda6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:19.571774 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-3f3017cb-fb14-459f-8ada-40136d48fda6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:19.572943 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-3f3017cb-fb14-459f-8ada-40136d48fda6 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1725 microversion: 2.20 time: 0.151459 Jun 16 00:34:19.573494 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 384/784] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:34:19 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:34:20.223927 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-dbeb65ed-6f80-4036-840e-31b17b8fd86c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:20.224502 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-dbeb65ed-6f80-4036-840e-31b17b8fd86c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:20.230947 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-dbeb65ed-6f80-4036-840e-31b17b8fd86c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:20.231396 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-dbeb65ed-6f80-4036-840e-31b17b8fd86c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:20.232136 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-dbeb65ed-6f80-4036-840e-31b17b8fd86c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:20.232560 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-dbeb65ed-6f80-4036-840e-31b17b8fd86c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:20.245607 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-dbeb65ed-6f80-4036-840e-31b17b8fd86c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] HTTP exception thrown: Instance 01d77a9c-3658-4db2-ab07-b248d1c7a230 could not be found. Jun 16 00:34:20.247206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-dbeb65ed-6f80-4036-840e-31b17b8fd86c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Request method failure captured: Jun 16 00:34:20.247206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: DELETE /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230 HTTP/1.1 Jun 16 00:34:20.247206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:34:20.247206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:34:20.247206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:34:20.247206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:34:20.247206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:34:20.247206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:34:20.247206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:34:20.247206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:20.247206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnlEQtlTYlcSb6Cxq7ka8JkFDrXY9ZTyYkOKl7RMv-Nc50AOOLvvYPcyo-002Bp2d50a3LSSgJspVILfxuCarFtF9OBY195yuIkdM0DVC_olTUnFngMBTQdDXeOL4IjwWYA5CoVYPq-YWQwNW1R5R2mbX6MVy2x9qf1Ysp-JTmbE9Gk Jun 16 00:34:20.247206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:34:20.247206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:34:20.247206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:34:20.247206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:34:20.247206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:34:20.247206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:34:20.247206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:34:20.247206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:20.247206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:34:20.247206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:34:20.248500 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:34:20.248500 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:20.248500 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:34:20.248500 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:20.248500 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:34:20.248500 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:34:20.248500 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:34:20.248500 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: 535a03ce19d346d59e6a6f6befb9dea0 Jun 16 00:34:20.248500 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:34:20.248500 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:34:20.248500 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Instance 01d77a9c-3658-4db2-ab07-b248d1c7a230 could not be found. Jun 16 00:34:20.248500 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': '01d77a9c-3658-4db2-ab07-b248d1c7a230'} Jun 16 00:34:20.250117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:20.250117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:20.250117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:34:20.250117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:34:20.250117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:34:20.250117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:34:20.250117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:34:20.250117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:34:20.250117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:34:20.250117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:34:20.250117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01d77a9c-3658-4db2-ab07-b248d1c7a230 could not be found. Jun 16 00:34:20.250117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:20.250117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:20.250117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:20.250117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:20.250117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:20.250117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:20.250117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:20.250117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:20.250117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:20.251662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:20.251662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:34:20.251662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:34:20.251662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:34:20.251662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:34:20.251662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:34:20.251662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:34:20.251662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:34:20.251662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:34:20.251662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01d77a9c-3658-4db2-ab07-b248d1c7a230 could not be found. Jun 16 00:34:20.251662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:20.251662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:20.251662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:20.251662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:20.251662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:20.251662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:20.251662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:34:20.251662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:34:20.251662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01d77a9c-3658-4db2-ab07-b248d1c7a230 could not be found. Jun 16 00:34:20.251662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:20.252833 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-dbeb65ed-6f80-4036-840e-31b17b8fd86c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Returning 404 to user: Instance 01d77a9c-3658-4db2-ab07-b248d1c7a230 could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:20.252833 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-dbeb65ed-6f80-4036-840e-31b17b8fd86c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "DELETE /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230" status: 404 len: 111 microversion: 2.1 time: 0.028748 Jun 16 00:34:20.252833 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 401/785] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:34:20 2022] DELETE /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:34:20.257174 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-68586f01-fa1b-4a49-a278-6b50a42b2628 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:20.257777 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-68586f01-fa1b-4a49-a278-6b50a42b2628 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 01d77a9c-3658-4db2-ab07-b248d1c7a230] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:20.264129 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-68586f01-fa1b-4a49-a278-6b50a42b2628 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:20.264567 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-68586f01-fa1b-4a49-a278-6b50a42b2628 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:20.266073 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-68586f01-fa1b-4a49-a278-6b50a42b2628 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:20.266809 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-68586f01-fa1b-4a49-a278-6b50a42b2628 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:20.279802 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-68586f01-fa1b-4a49-a278-6b50a42b2628 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] HTTP exception thrown: Instance 01d77a9c-3658-4db2-ab07-b248d1c7a230 could not be found. Jun 16 00:34:20.282116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-68586f01-fa1b-4a49-a278-6b50a42b2628 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Request method failure captured: Jun 16 00:34:20.282116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230 HTTP/1.1 Jun 16 00:34:20.282116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:34:20.282116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:34:20.282116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:34:20.282116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:34:20.282116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:34:20.282116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:34:20.282116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:34:20.282116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:20.282116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnlEQtlTYlcSb6Cxq7ka8JkFDrXY9ZTyYkOKl7RMv-Nc50AOOLvvYPcyo-002Bp2d50a3LSSgJspVILfxuCarFtF9OBY195yuIkdM0DVC_olTUnFngMBTQdDXeOL4IjwWYA5CoVYPq-YWQwNW1R5R2mbX6MVy2x9qf1Ysp-JTmbE9Gk Jun 16 00:34:20.282116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:34:20.282116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:34:20.282116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:34:20.282116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:34:20.282116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:34:20.282116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:34:20.282116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:34:20.282116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:20.282116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:34:20.282116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:34:20.283998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:34:20.283998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:20.283998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:34:20.283998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:20.283998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:34:20.283998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:34:20.283998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:34:20.283998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: 535a03ce19d346d59e6a6f6befb9dea0 Jun 16 00:34:20.283998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:34:20.283998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: > Jun 16 00:34:20.283998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Instance 01d77a9c-3658-4db2-ab07-b248d1c7a230 could not be found. Jun 16 00:34:20.283998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'id': '01d77a9c-3658-4db2-ab07-b248d1c7a230'} Jun 16 00:34:20.285034 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:20.285034 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:20.285034 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:34:20.285034 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:34:20.285034 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:34:20.285034 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:34:20.285034 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:34:20.285034 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:34:20.285034 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:34:20.285034 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:34:20.285034 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01d77a9c-3658-4db2-ab07-b248d1c7a230 could not be found. Jun 16 00:34:20.285034 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:20.285034 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:20.285034 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:20.285034 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:20.285034 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:20.285034 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:20.285034 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:20.285034 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:20.285034 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:20.286439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:20.286439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:34:20.286439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:34:20.286439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:34:20.286439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:34:20.286439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:34:20.286439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:34:20.286439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01d77a9c-3658-4db2-ab07-b248d1c7a230 could not be found. Jun 16 00:34:20.286439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:20.286439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:20.286439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:20.286439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:20.286439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:20.286439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:20.286439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:34:20.286439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:34:20.286439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01d77a9c-3658-4db2-ab07-b248d1c7a230 could not be found. Jun 16 00:34:20.286439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:20.287732 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-68586f01-fa1b-4a49-a278-6b50a42b2628 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Returning 404 to user: Instance 01d77a9c-3658-4db2-ab07-b248d1c7a230 could not be found. {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:20.287732 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-68586f01-fa1b-4a49-a278-6b50a42b2628 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230" status: 404 len: 111 microversion: 2.1 time: 0.030034 Jun 16 00:34:20.287732 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 385/786] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:20 2022] GET /compute/v2.1/servers/01d77a9c-3658-4db2-ab07-b248d1c7a230 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:34:20.291657 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-454746b4-f1a8-4987-bac6-9f1fca359b0c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:20.292157 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-454746b4-f1a8-4987-bac6-9f1fca359b0c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:20.298400 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-454746b4-f1a8-4987-bac6-9f1fca359b0c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:20.298880 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-454746b4-f1a8-4987-bac6-9f1fca359b0c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:20.299641 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-454746b4-f1a8-4987-bac6-9f1fca359b0c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:20.300074 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-454746b4-f1a8-4987-bac6-9f1fca359b0c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:20.313276 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-454746b4-f1a8-4987-bac6-9f1fca359b0c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] HTTP exception thrown: Instance 52832e7d-aae4-4a38-81ec-e84727dd8d66 could not be found. Jun 16 00:34:20.314776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-454746b4-f1a8-4987-bac6-9f1fca359b0c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Request method failure captured: Jun 16 00:34:20.314776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: DELETE /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 HTTP/1.1 Jun 16 00:34:20.314776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:34:20.314776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:34:20.314776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:34:20.314776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:34:20.314776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:34:20.314776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:34:20.314776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:34:20.314776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:20.314776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnlEQtlTYlcSb6Cxq7ka8JkFDrXY9ZTyYkOKl7RMv-Nc50AOOLvvYPcyo-002Bp2d50a3LSSgJspVILfxuCarFtF9OBY195yuIkdM0DVC_olTUnFngMBTQdDXeOL4IjwWYA5CoVYPq-YWQwNW1R5R2mbX6MVy2x9qf1Ysp-JTmbE9Gk Jun 16 00:34:20.314776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:34:20.314776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:34:20.314776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:34:20.314776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:34:20.314776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:34:20.314776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:34:20.314776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:34:20.314776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:20.314776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:34:20.314776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:34:20.316245 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:34:20.316245 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:20.316245 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:34:20.316245 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:20.316245 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:34:20.316245 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:34:20.316245 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:34:20.316245 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: 535a03ce19d346d59e6a6f6befb9dea0 Jun 16 00:34:20.316245 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:34:20.316245 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:34:20.316245 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Instance 52832e7d-aae4-4a38-81ec-e84727dd8d66 could not be found. Jun 16 00:34:20.316245 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': '52832e7d-aae4-4a38-81ec-e84727dd8d66'} Jun 16 00:34:20.317210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:20.317210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:20.317210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:34:20.317210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:34:20.317210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:34:20.317210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:34:20.317210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:34:20.317210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:34:20.317210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:34:20.317210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:34:20.317210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52832e7d-aae4-4a38-81ec-e84727dd8d66 could not be found. Jun 16 00:34:20.317210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:20.317210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:20.317210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:20.317210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:20.317210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:20.317210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:20.317210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:20.317210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:20.317210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:20.318733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:20.318733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:34:20.318733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:34:20.318733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:34:20.318733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:34:20.318733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:34:20.318733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:34:20.318733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:34:20.318733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:34:20.318733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52832e7d-aae4-4a38-81ec-e84727dd8d66 could not be found. Jun 16 00:34:20.318733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:20.318733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:20.318733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:20.318733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:20.318733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:20.318733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:20.318733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:34:20.318733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:34:20.318733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52832e7d-aae4-4a38-81ec-e84727dd8d66 could not be found. Jun 16 00:34:20.318733 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:20.320201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-454746b4-f1a8-4987-bac6-9f1fca359b0c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Returning 404 to user: Instance 52832e7d-aae4-4a38-81ec-e84727dd8d66 could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:20.320201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-454746b4-f1a8-4987-bac6-9f1fca359b0c tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "DELETE /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66" status: 404 len: 111 microversion: 2.1 time: 0.028233 Jun 16 00:34:20.320201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 402/787] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:34:20 2022] DELETE /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:34:20.324241 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-4672eaf1-435f-4fd1-bec1-6d709ce6f2a1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:20.324862 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-4672eaf1-435f-4fd1-bec1-6d709ce6f2a1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 52832e7d-aae4-4a38-81ec-e84727dd8d66] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:20.331542 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4672eaf1-435f-4fd1-bec1-6d709ce6f2a1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:20.331983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4672eaf1-435f-4fd1-bec1-6d709ce6f2a1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:20.332736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4672eaf1-435f-4fd1-bec1-6d709ce6f2a1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:20.333193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4672eaf1-435f-4fd1-bec1-6d709ce6f2a1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:20.346975 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-4672eaf1-435f-4fd1-bec1-6d709ce6f2a1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] HTTP exception thrown: Instance 52832e7d-aae4-4a38-81ec-e84727dd8d66 could not be found. Jun 16 00:34:20.348431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-4672eaf1-435f-4fd1-bec1-6d709ce6f2a1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Request method failure captured: Jun 16 00:34:20.348431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 HTTP/1.1 Jun 16 00:34:20.348431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:34:20.348431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:34:20.348431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:34:20.348431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:34:20.348431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:34:20.348431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:34:20.348431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:34:20.348431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:20.348431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnlEQtlTYlcSb6Cxq7ka8JkFDrXY9ZTyYkOKl7RMv-Nc50AOOLvvYPcyo-002Bp2d50a3LSSgJspVILfxuCarFtF9OBY195yuIkdM0DVC_olTUnFngMBTQdDXeOL4IjwWYA5CoVYPq-YWQwNW1R5R2mbX6MVy2x9qf1Ysp-JTmbE9Gk Jun 16 00:34:20.348431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:34:20.348431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:34:20.348431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:34:20.348431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:34:20.348431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:34:20.348431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:34:20.348431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:34:20.348431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:20.348431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:34:20.348431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:34:20.349998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:34:20.349998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:20.349998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:34:20.349998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:20.349998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:34:20.349998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:34:20.349998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:34:20.349998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: 535a03ce19d346d59e6a6f6befb9dea0 Jun 16 00:34:20.349998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:34:20.349998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: > Jun 16 00:34:20.349998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Instance 52832e7d-aae4-4a38-81ec-e84727dd8d66 could not be found. Jun 16 00:34:20.349998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'id': '52832e7d-aae4-4a38-81ec-e84727dd8d66'} Jun 16 00:34:20.351003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:20.351003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:20.351003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:34:20.351003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:34:20.351003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:34:20.351003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:34:20.351003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:34:20.351003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:34:20.351003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:34:20.351003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:34:20.351003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52832e7d-aae4-4a38-81ec-e84727dd8d66 could not be found. Jun 16 00:34:20.351003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:20.351003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:20.351003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:20.351003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:20.351003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:20.351003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:20.351003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:20.351003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:20.351003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:20.352399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:20.352399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:34:20.352399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:34:20.352399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:34:20.352399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:34:20.352399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:34:20.352399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:34:20.352399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52832e7d-aae4-4a38-81ec-e84727dd8d66 could not be found. Jun 16 00:34:20.352399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:20.352399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:20.352399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:20.352399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:20.352399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:20.352399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:20.352399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:34:20.352399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:34:20.352399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52832e7d-aae4-4a38-81ec-e84727dd8d66 could not be found. Jun 16 00:34:20.352399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:20.353776 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-4672eaf1-435f-4fd1-bec1-6d709ce6f2a1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Returning 404 to user: Instance 52832e7d-aae4-4a38-81ec-e84727dd8d66 could not be found. {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:20.353776 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-4672eaf1-435f-4fd1-bec1-6d709ce6f2a1 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66" status: 404 len: 111 microversion: 2.1 time: 0.029328 Jun 16 00:34:20.353776 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 386/788] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:20 2022] GET /compute/v2.1/servers/52832e7d-aae4-4a38-81ec-e84727dd8d66 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:34:20.590701 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-0104b2ac-bd8d-4186-bf36-acc2b93afd78 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:20.591312 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-0104b2ac-bd8d-4186-bf36-acc2b93afd78 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:20.597571 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0104b2ac-bd8d-4186-bf36-acc2b93afd78 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:20.598031 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0104b2ac-bd8d-4186-bf36-acc2b93afd78 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:20.598815 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0104b2ac-bd8d-4186-bf36-acc2b93afd78 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:20.599248 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0104b2ac-bd8d-4186-bf36-acc2b93afd78 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:20.736205 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-0104b2ac-bd8d-4186-bf36-acc2b93afd78 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:20.744171 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-0104b2ac-bd8d-4186-bf36-acc2b93afd78 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:20.745712 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-0104b2ac-bd8d-4186-bf36-acc2b93afd78 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:20.746849 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-0104b2ac-bd8d-4186-bf36-acc2b93afd78 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1725 microversion: 2.20 time: 0.160150 Jun 16 00:34:20.747428 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 403/789] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:34:20 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:34:21.486158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-7a0d2699-9b0e-4309-a5d7-9cb88f67f955 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:21.486683 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-7a0d2699-9b0e-4309-a5d7-9cb88f67f955 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:21.488972 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=48 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:21.494193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7a0d2699-9b0e-4309-a5d7-9cb88f67f955 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:21.494659 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7a0d2699-9b0e-4309-a5d7-9cb88f67f955 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:21.495404 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7a0d2699-9b0e-4309-a5d7-9cb88f67f955 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:21.495832 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7a0d2699-9b0e-4309-a5d7-9cb88f67f955 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:21.511035 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-7a0d2699-9b0e-4309-a5d7-9cb88f67f955 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] HTTP exception thrown: Instance 401cad35-961b-4abf-a04c-796236ed5124 could not be found. Jun 16 00:34:21.512544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-7a0d2699-9b0e-4309-a5d7-9cb88f67f955 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Request method failure captured: Jun 16 00:34:21.512544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: DELETE /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124 HTTP/1.1 Jun 16 00:34:21.512544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:34:21.512544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:34:21.512544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:34:21.512544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:34:21.512544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:34:21.512544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:34:21.512544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:34:21.512544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:21.512544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnlEQtlTYlcSb6Cxq7ka8JkFDrXY9ZTyYkOKl7RMv-Nc50AOOLvvYPcyo-002Bp2d50a3LSSgJspVILfxuCarFtF9OBY195yuIkdM0DVC_olTUnFngMBTQdDXeOL4IjwWYA5CoVYPq-YWQwNW1R5R2mbX6MVy2x9qf1Ysp-JTmbE9Gk Jun 16 00:34:21.512544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:34:21.512544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:34:21.512544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:34:21.512544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:34:21.512544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:34:21.512544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:34:21.512544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:34:21.512544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:21.512544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:34:21.512544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:34:21.514411 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:34:21.514411 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:21.514411 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:34:21.514411 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:21.514411 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:34:21.514411 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:34:21.514411 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:34:21.514411 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: 535a03ce19d346d59e6a6f6befb9dea0 Jun 16 00:34:21.514411 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:34:21.514411 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: > Jun 16 00:34:21.514411 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Instance 401cad35-961b-4abf-a04c-796236ed5124 could not be found. Jun 16 00:34:21.514411 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'id': '401cad35-961b-4abf-a04c-796236ed5124'} Jun 16 00:34:21.515615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:21.515615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:21.515615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:34:21.515615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:34:21.515615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:34:21.515615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:34:21.515615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:34:21.515615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:34:21.515615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:34:21.515615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:34:21.515615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 401cad35-961b-4abf-a04c-796236ed5124 could not be found. Jun 16 00:34:21.515615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:21.515615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:21.515615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:21.515615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:21.515615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:21.515615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:21.515615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:21.515615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:21.515615 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:21.517342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:21.517342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:34:21.517342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:34:21.517342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:34:21.517342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:34:21.517342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:34:21.517342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:34:21.517342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:34:21.517342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:34:21.517342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 401cad35-961b-4abf-a04c-796236ed5124 could not be found. Jun 16 00:34:21.517342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:21.517342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:21.517342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:21.517342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:21.517342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:21.517342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:21.517342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:34:21.517342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:34:21.517342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 401cad35-961b-4abf-a04c-796236ed5124 could not be found. Jun 16 00:34:21.517342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:21.518567 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-7a0d2699-9b0e-4309-a5d7-9cb88f67f955 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Returning 404 to user: Instance 401cad35-961b-4abf-a04c-796236ed5124 could not be found. {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:21.518567 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-7a0d2699-9b0e-4309-a5d7-9cb88f67f955 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "DELETE /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124" status: 404 len: 111 microversion: 2.1 time: 0.032900 Jun 16 00:34:21.518567 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 387/790] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:34:21 2022] DELETE /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:34:21.523301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-4b0168ab-b15e-4010-9ae3-ca008b7fed98 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:21.523905 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-4b0168ab-b15e-4010-9ae3-ca008b7fed98 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] [instance: 401cad35-961b-4abf-a04c-796236ed5124] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:21.530283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4b0168ab-b15e-4010-9ae3-ca008b7fed98 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:21.531251 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4b0168ab-b15e-4010-9ae3-ca008b7fed98 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:21.532120 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4b0168ab-b15e-4010-9ae3-ca008b7fed98 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:21.532563 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4b0168ab-b15e-4010-9ae3-ca008b7fed98 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:21.545662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-4b0168ab-b15e-4010-9ae3-ca008b7fed98 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] HTTP exception thrown: Instance 401cad35-961b-4abf-a04c-796236ed5124 could not be found. Jun 16 00:34:21.547876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-4b0168ab-b15e-4010-9ae3-ca008b7fed98 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Request method failure captured: Jun 16 00:34:21.547876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124 HTTP/1.1 Jun 16 00:34:21.547876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:34:21.547876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:34:21.547876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:34:21.547876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:34:21.547876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:34:21.547876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:34:21.547876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:34:21.547876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:21.547876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnlEQtlTYlcSb6Cxq7ka8JkFDrXY9ZTyYkOKl7RMv-Nc50AOOLvvYPcyo-002Bp2d50a3LSSgJspVILfxuCarFtF9OBY195yuIkdM0DVC_olTUnFngMBTQdDXeOL4IjwWYA5CoVYPq-YWQwNW1R5R2mbX6MVy2x9qf1Ysp-JTmbE9Gk Jun 16 00:34:21.547876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:34:21.547876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:34:21.547876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:34:21.547876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:34:21.547876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:34:21.547876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:34:21.547876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:34:21.547876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:21.547876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:34:21.547876 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:34:21.549574 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d5d56c0c6444b23a1ac6cc2fcb0bb52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:34:21.549574 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:21.549574 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: 2d5d56c0c6444b23a1ac6cc2fcb0bb52 Jun 16 00:34:21.549574 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2018231059 Jun 16 00:34:21.549574 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:34:21.549574 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:34:21.549574 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:34:21.549574 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: 535a03ce19d346d59e6a6f6befb9dea0 Jun 16 00:34:21.549574 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-AttachVolumeNegativeTest-2018231059-project Jun 16 00:34:21.549574 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:34:21.549574 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Instance 401cad35-961b-4abf-a04c-796236ed5124 could not be found. Jun 16 00:34:21.549574 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': '401cad35-961b-4abf-a04c-796236ed5124'} Jun 16 00:34:21.550364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:21.550364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:21.550364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:34:21.550364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:34:21.550364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:34:21.550364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:34:21.550364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:34:21.550364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:34:21.550364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:34:21.550364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:34:21.550364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 401cad35-961b-4abf-a04c-796236ed5124 could not be found. Jun 16 00:34:21.550364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:21.550364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:21.550364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:21.550364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:21.550364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:21.550364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:21.550364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:21.550364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:21.550364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:21.551782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:21.551782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:34:21.551782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:34:21.551782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:34:21.551782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:34:21.551782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:34:21.551782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:34:21.551782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 401cad35-961b-4abf-a04c-796236ed5124 could not be found. Jun 16 00:34:21.551782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:21.551782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:21.551782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:21.551782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:21.551782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:21.551782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:21.551782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:34:21.551782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:34:21.551782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 401cad35-961b-4abf-a04c-796236ed5124 could not be found. Jun 16 00:34:21.551782 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:21.553079 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-4b0168ab-b15e-4010-9ae3-ca008b7fed98 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] Returning 404 to user: Instance 401cad35-961b-4abf-a04c-796236ed5124 could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:21.553079 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-4b0168ab-b15e-4010-9ae3-ca008b7fed98 tempest-AttachVolumeNegativeTest-2018231059 tempest-AttachVolumeNegativeTest-2018231059-project] 10.222.0.23 "GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124" status: 404 len: 111 microversion: 2.1 time: 0.029727 Jun 16 00:34:21.553079 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 404/791] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:21 2022] GET /compute/v2.1/servers/401cad35-961b-4abf-a04c-796236ed5124 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:34:21.767224 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-62218c80-61e7-4f93-9c3e-eeaa361478e0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:21.767938 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-62218c80-61e7-4f93-9c3e-eeaa361478e0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:21.775338 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-62218c80-61e7-4f93-9c3e-eeaa361478e0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:21.775922 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-62218c80-61e7-4f93-9c3e-eeaa361478e0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:21.776794 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-62218c80-61e7-4f93-9c3e-eeaa361478e0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:21.777344 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-62218c80-61e7-4f93-9c3e-eeaa361478e0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:21.820273 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-0331c368-6a44-42b5-8e87-8f74b2108089 req-34e7da25-8abe-4434-9c50-ca7091850fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86b6066-9081-4634-b4da-e5c5ddd72e9d", "name": "network-vif-deleted", "tag": "308b71f6-0824-4328-b466-16c67900f36f"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:34:21.855505 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-0331c368-6a44-42b5-8e87-8f74b2108089 req-34e7da25-8abe-4434-9c50-ca7091850fb9 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:21.856006 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-0331c368-6a44-42b5-8e87-8f74b2108089 req-34e7da25-8abe-4434-9c50-ca7091850fb9 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:21.899510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-0331c368-6a44-42b5-8e87-8f74b2108089 req-34e7da25-8abe-4434-9c50-ca7091850fb9 service nova] Creating event network-vif-deleted:308b71f6-0824-4328-b466-16c67900f36f for instance d86b6066-9081-4634-b4da-e5c5ddd72e9d on hv-cinder-84599 Jun 16 00:34:21.915278 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-62218c80-61e7-4f93-9c3e-eeaa361478e0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:21.921239 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-0331c368-6a44-42b5-8e87-8f74b2108089 req-34e7da25-8abe-4434-9c50-ca7091850fb9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115918 Jun 16 00:34:21.924350 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 405/792] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:21.926830 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-62218c80-61e7-4f93-9c3e-eeaa361478e0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:21.928709 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-62218c80-61e7-4f93-9c3e-eeaa361478e0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1d7bb8f9d364c5198313fedd982478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8526627add42a597eff6fce7400885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:21.930113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-62218c80-61e7-4f93-9c3e-eeaa361478e0 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 200 len: 1657 microversion: 2.20 time: 0.168670 Jun 16 00:34:21.930738 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 388/793] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:34:21 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 1657 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:34:22.949039 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-271b0faa-81b0-4d54-bbac-d65acf3b943d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:22.949893 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-271b0faa-81b0-4d54-bbac-d65acf3b943d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:22.957361 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-271b0faa-81b0-4d54-bbac-d65acf3b943d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:22.957814 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-271b0faa-81b0-4d54-bbac-d65acf3b943d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:22.958597 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-271b0faa-81b0-4d54-bbac-d65acf3b943d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:22.959029 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-271b0faa-81b0-4d54-bbac-d65acf3b943d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:22.980804 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-271b0faa-81b0-4d54-bbac-d65acf3b943d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] HTTP exception thrown: Instance d86b6066-9081-4634-b4da-e5c5ddd72e9d could not be found. Jun 16 00:34:22.982510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-271b0faa-81b0-4d54-bbac-d65acf3b943d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Request method failure captured: Jun 16 00:34:22.982510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d HTTP/1.1 Jun 16 00:34:22.982510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:34:22.982510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:34:22.982510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:34:22.982510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:34:22.982510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:34:22.982510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:34:22.982510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:34:22.982510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:22.982510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnjkhYlnMQoJ6ll5DrxE3jVjof5ziwEcy_ENCJr9EqNSCv5ft04TUZZMBwQ1TNaX7gwedC-UXKiOJfwj-Zdfn04VMxb4f_qzjcrcCy16D8HNCbItqG2lNqbspZeOeulmf6LrG9KrmktpCZB5nBMoQF_kFqjoBnX9XETTs8rEZ7djSHI Jun 16 00:34:22.982510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:34:22.982510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:34:22.982510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:34:22.982510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:34:22.982510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 00:34:22.982510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:34:22.982510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:34:22.982510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: cd8526627add42a597eff6fce7400885 Jun 16 00:34:22.982510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-546813573 Jun 16 00:34:22.982510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:34:22.982510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:34:22.984178 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cd8526627add42a597eff6fce7400885"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cd8526627add42a597eff6fce7400885"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd8526627add42a597eff6fce7400885"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd8526627add42a597eff6fce7400885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:34:22.984178 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-AttachVolumeShelveTestJSON-546813573 Jun 16 00:34:22.984178 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: cd8526627add42a597eff6fce7400885 Jun 16 00:34:22.984178 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-546813573 Jun 16 00:34:22.984178 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-AttachVolumeShelveTestJSON-546813573-project Jun 16 00:34:22.984178 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:34:22.984178 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:34:22.984178 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: f1d7bb8f9d364c5198313fedd982478a Jun 16 00:34:22.984178 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-AttachVolumeShelveTestJSON-546813573-project Jun 16 00:34:22.984178 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:34:22.984178 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Instance d86b6066-9081-4634-b4da-e5c5ddd72e9d could not be found. Jun 16 00:34:22.984178 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': 'd86b6066-9081-4634-b4da-e5c5ddd72e9d'} Jun 16 00:34:22.985099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:22.985099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:22.985099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:34:22.985099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:34:22.985099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:34:22.985099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:34:22.985099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:34:22.985099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:34:22.985099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:34:22.985099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:34:22.985099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d86b6066-9081-4634-b4da-e5c5ddd72e9d could not be found. Jun 16 00:34:22.985099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:22.985099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:22.985099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:22.985099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:22.985099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:22.985099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:22.985099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:22.985099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:22.985099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:22.986551 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:22.986551 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:34:22.986551 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:34:22.986551 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:34:22.986551 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:34:22.986551 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:34:22.986551 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:34:22.986551 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d86b6066-9081-4634-b4da-e5c5ddd72e9d could not be found. Jun 16 00:34:22.986551 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:22.986551 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:22.986551 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:22.986551 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:22.986551 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:22.986551 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:22.986551 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:34:22.986551 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:34:22.986551 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d86b6066-9081-4634-b4da-e5c5ddd72e9d could not be found. Jun 16 00:34:22.986551 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:22.988645 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-271b0faa-81b0-4d54-bbac-d65acf3b943d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Returning 404 to user: Instance d86b6066-9081-4634-b4da-e5c5ddd72e9d could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:22.988645 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-271b0faa-81b0-4d54-bbac-d65acf3b943d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 404 len: 111 microversion: 2.20 time: 0.039724 Jun 16 00:34:22.988645 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 406/794] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:34:22 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:34:22.993575 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-16a0d56b-48e9-4689-a26d-3cfeaea43c3d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '.version_select at 0x7fe704867550>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:23.019789 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-16a0d56b-48e9-4689-a26d-3cfeaea43c3d tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-699043444" status: 204 len: 0 microversion: 2.20 time: 0.029814 Jun 16 00:34:23.037957 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 389/795] 10.222.0.23 () {60 vars in 1258 bytes} [Thu Jun 16 00:34:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-699043444 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 00:34:24.841615 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-785f47d2-706d-48a8-a664-74f86d32a21a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:24.848535 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-785f47d2-706d-48a8-a664-74f86d32a21a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:24.865170 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-785f47d2-706d-48a8-a664-74f86d32a21a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:24.866673 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-785f47d2-706d-48a8-a664-74f86d32a21a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:24.867715 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-785f47d2-706d-48a8-a664-74f86d32a21a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:24.868375 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-785f47d2-706d-48a8-a664-74f86d32a21a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:24.889136 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-785f47d2-706d-48a8-a664-74f86d32a21a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] HTTP exception thrown: Instance d86b6066-9081-4634-b4da-e5c5ddd72e9d could not be found. Jun 16 00:34:24.890958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-785f47d2-706d-48a8-a664-74f86d32a21a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Request method failure captured: Jun 16 00:34:24.890958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: DELETE /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d HTTP/1.1 Jun 16 00:34:24.890958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:34:24.890958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:34:24.890958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:34:24.890958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:34:24.890958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:34:24.890958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:34:24.890958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:34:24.890958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:24.890958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnjkhYlnMQoJ6ll5DrxE3jVjof5ziwEcy_ENCJr9EqNSCv5ft04TUZZMBwQ1TNaX7gwedC-UXKiOJfwj-Zdfn04VMxb4f_qzjcrcCy16D8HNCbItqG2lNqbspZeOeulmf6LrG9KrmktpCZB5nBMoQF_kFqjoBnX9XETTs8rEZ7djSHI Jun 16 00:34:24.890958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:34:24.890958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:34:24.890958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:34:24.890958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:34:24.890958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 00:34:24.890958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:34:24.890958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:34:24.890958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: cd8526627add42a597eff6fce7400885 Jun 16 00:34:24.890958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-546813573 Jun 16 00:34:24.890958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:34:24.890958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:34:24.892943 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cd8526627add42a597eff6fce7400885"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cd8526627add42a597eff6fce7400885"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd8526627add42a597eff6fce7400885"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd8526627add42a597eff6fce7400885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:34:24.892943 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-AttachVolumeShelveTestJSON-546813573 Jun 16 00:34:24.892943 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: cd8526627add42a597eff6fce7400885 Jun 16 00:34:24.892943 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-546813573 Jun 16 00:34:24.892943 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-AttachVolumeShelveTestJSON-546813573-project Jun 16 00:34:24.892943 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:34:24.892943 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:34:24.892943 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: f1d7bb8f9d364c5198313fedd982478a Jun 16 00:34:24.892943 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-AttachVolumeShelveTestJSON-546813573-project Jun 16 00:34:24.892943 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:34:24.892943 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Instance d86b6066-9081-4634-b4da-e5c5ddd72e9d could not be found. Jun 16 00:34:24.892943 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': 'd86b6066-9081-4634-b4da-e5c5ddd72e9d'} Jun 16 00:34:24.893740 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:24.893740 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:24.893740 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:34:24.893740 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:34:24.893740 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:34:24.893740 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:34:24.893740 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:34:24.893740 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:34:24.893740 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:34:24.893740 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:34:24.893740 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d86b6066-9081-4634-b4da-e5c5ddd72e9d could not be found. Jun 16 00:34:24.893740 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:24.893740 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:24.893740 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:24.893740 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:24.893740 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:24.893740 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:24.893740 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:24.893740 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:24.893740 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:24.894906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:24.894906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:34:24.894906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:34:24.894906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:34:24.894906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:34:24.894906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:34:24.894906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:34:24.894906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:34:24.894906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:34:24.894906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d86b6066-9081-4634-b4da-e5c5ddd72e9d could not be found. Jun 16 00:34:24.894906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:24.894906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:24.894906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:24.894906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:24.894906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:24.894906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:24.894906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:34:24.894906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:34:24.894906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d86b6066-9081-4634-b4da-e5c5ddd72e9d could not be found. Jun 16 00:34:24.894906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:24.896965 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-785f47d2-706d-48a8-a664-74f86d32a21a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Returning 404 to user: Instance d86b6066-9081-4634-b4da-e5c5ddd72e9d could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:24.898449 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-785f47d2-706d-48a8-a664-74f86d32a21a tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 404 len: 111 microversion: 2.20 time: 0.062689 Jun 16 00:34:24.899537 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 407/796] 10.222.0.23 () {60 vars in 1279 bytes} [Thu Jun 16 00:34:24 2022] DELETE /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:34:24.915788 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5a78bc8e-50cd-442c-b883-3057e7490f8e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:24.916394 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-5a78bc8e-50cd-442c-b883-3057e7490f8e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: d86b6066-9081-4634-b4da-e5c5ddd72e9d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:24.928621 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5a78bc8e-50cd-442c-b883-3057e7490f8e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:24.929190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5a78bc8e-50cd-442c-b883-3057e7490f8e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:24.930145 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5a78bc8e-50cd-442c-b883-3057e7490f8e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:24.930602 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5a78bc8e-50cd-442c-b883-3057e7490f8e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:24.945422 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-5a78bc8e-50cd-442c-b883-3057e7490f8e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] HTTP exception thrown: Instance d86b6066-9081-4634-b4da-e5c5ddd72e9d could not be found. Jun 16 00:34:24.946956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5a78bc8e-50cd-442c-b883-3057e7490f8e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Request method failure captured: Jun 16 00:34:24.946956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d HTTP/1.1 Jun 16 00:34:24.946956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:34:24.946956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:34:24.946956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:34:24.946956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:34:24.946956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:34:24.946956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:34:24.946956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:34:24.946956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:24.946956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnjkhYlnMQoJ6ll5DrxE3jVjof5ziwEcy_ENCJr9EqNSCv5ft04TUZZMBwQ1TNaX7gwedC-UXKiOJfwj-Zdfn04VMxb4f_qzjcrcCy16D8HNCbItqG2lNqbspZeOeulmf6LrG9KrmktpCZB5nBMoQF_kFqjoBnX9XETTs8rEZ7djSHI Jun 16 00:34:24.946956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:34:24.946956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:34:24.946956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:34:24.946956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:34:24.946956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 00:34:24.946956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:34:24.946956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:34:24.946956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: cd8526627add42a597eff6fce7400885 Jun 16 00:34:24.946956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-546813573 Jun 16 00:34:24.946956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:34:24.946956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:34:24.948605 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cd8526627add42a597eff6fce7400885"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cd8526627add42a597eff6fce7400885"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd8526627add42a597eff6fce7400885"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd8526627add42a597eff6fce7400885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:34:24.948605 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-AttachVolumeShelveTestJSON-546813573 Jun 16 00:34:24.948605 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: cd8526627add42a597eff6fce7400885 Jun 16 00:34:24.948605 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-546813573 Jun 16 00:34:24.948605 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-AttachVolumeShelveTestJSON-546813573-project Jun 16 00:34:24.948605 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:34:24.948605 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:34:24.948605 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: f1d7bb8f9d364c5198313fedd982478a Jun 16 00:34:24.948605 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-AttachVolumeShelveTestJSON-546813573-project Jun 16 00:34:24.948605 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: > Jun 16 00:34:24.948605 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Instance d86b6066-9081-4634-b4da-e5c5ddd72e9d could not be found. Jun 16 00:34:24.948605 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'id': 'd86b6066-9081-4634-b4da-e5c5ddd72e9d'} Jun 16 00:34:24.953341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:24.953341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:24.953341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:34:24.953341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:34:24.953341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:34:24.953341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:34:24.953341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:34:24.953341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:34:24.953341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:34:24.953341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:34:24.953341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d86b6066-9081-4634-b4da-e5c5ddd72e9d could not be found. Jun 16 00:34:24.953341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:24.953341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:24.953341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:24.953341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:24.953341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:24.953341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:24.953341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:24.953341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:24.953341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:24.955088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:24.955088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:34:24.955088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:34:24.955088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:34:24.955088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:34:24.955088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:34:24.955088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:34:24.955088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d86b6066-9081-4634-b4da-e5c5ddd72e9d could not be found. Jun 16 00:34:24.955088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:24.955088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:24.955088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:24.955088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:24.955088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:24.955088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:24.955088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:34:24.955088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:34:24.955088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d86b6066-9081-4634-b4da-e5c5ddd72e9d could not be found. Jun 16 00:34:24.955088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:24.956158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5a78bc8e-50cd-442c-b883-3057e7490f8e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Returning 404 to user: Instance d86b6066-9081-4634-b4da-e5c5ddd72e9d could not be found. {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:24.956158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-5a78bc8e-50cd-442c-b883-3057e7490f8e tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d" status: 404 len: 111 microversion: 2.20 time: 0.044025 Jun 16 00:34:24.956158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 390/797] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:34:24 2022] GET /compute/v2.1/servers/d86b6066-9081-4634-b4da-e5c5ddd72e9d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:34:26.106265 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-52a79ec4-e0a3-41b0-a740-c861c68eefdd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:26.106735 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-52a79ec4-e0a3-41b0-a740-c861c68eefdd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:26.113097 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-52a79ec4-e0a3-41b0-a740-c861c68eefdd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:26.113538 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-52a79ec4-e0a3-41b0-a740-c861c68eefdd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:26.114269 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-52a79ec4-e0a3-41b0-a740-c861c68eefdd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:26.114695 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-52a79ec4-e0a3-41b0-a740-c861c68eefdd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:26.130580 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-52a79ec4-e0a3-41b0-a740-c861c68eefdd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] HTTP exception thrown: Instance 6b227643-24e7-44b6-acf7-d3801014a8c7 could not be found. Jun 16 00:34:26.133437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-52a79ec4-e0a3-41b0-a740-c861c68eefdd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Request method failure captured: Jun 16 00:34:26.133437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: DELETE /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 HTTP/1.1 Jun 16 00:34:26.133437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:34:26.133437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:34:26.133437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:34:26.133437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:34:26.133437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:34:26.133437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:34:26.133437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:34:26.133437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:26.133437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnjkhYlnMQoJ6ll5DrxE3jVjof5ziwEcy_ENCJr9EqNSCv5ft04TUZZMBwQ1TNaX7gwedC-UXKiOJfwj-Zdfn04VMxb4f_qzjcrcCy16D8HNCbItqG2lNqbspZeOeulmf6LrG9KrmktpCZB5nBMoQF_kFqjoBnX9XETTs8rEZ7djSHI Jun 16 00:34:26.133437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:34:26.133437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:34:26.133437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:34:26.133437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:34:26.133437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 00:34:26.133437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:34:26.133437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:34:26.133437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: cd8526627add42a597eff6fce7400885 Jun 16 00:34:26.133437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-546813573 Jun 16 00:34:26.133437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:34:26.133437 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:34:26.135089 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cd8526627add42a597eff6fce7400885"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cd8526627add42a597eff6fce7400885"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd8526627add42a597eff6fce7400885"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd8526627add42a597eff6fce7400885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:34:26.135089 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-AttachVolumeShelveTestJSON-546813573 Jun 16 00:34:26.135089 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: cd8526627add42a597eff6fce7400885 Jun 16 00:34:26.135089 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-546813573 Jun 16 00:34:26.135089 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-AttachVolumeShelveTestJSON-546813573-project Jun 16 00:34:26.135089 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:34:26.135089 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:34:26.135089 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: f1d7bb8f9d364c5198313fedd982478a Jun 16 00:34:26.135089 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-AttachVolumeShelveTestJSON-546813573-project Jun 16 00:34:26.135089 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:34:26.135089 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Instance 6b227643-24e7-44b6-acf7-d3801014a8c7 could not be found. Jun 16 00:34:26.135089 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': '6b227643-24e7-44b6-acf7-d3801014a8c7'} Jun 16 00:34:26.135872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:26.135872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:26.135872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:34:26.135872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:34:26.135872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:34:26.135872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:34:26.135872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:34:26.135872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:34:26.135872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:34:26.135872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:34:26.135872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b227643-24e7-44b6-acf7-d3801014a8c7 could not be found. Jun 16 00:34:26.135872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:26.135872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:26.135872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:26.135872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:26.135872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:26.135872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:26.135872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:26.135872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:26.135872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:26.137080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:26.137080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:34:26.137080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:34:26.137080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:34:26.137080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:34:26.137080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:34:26.137080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:34:26.137080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:34:26.137080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:34:26.137080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b227643-24e7-44b6-acf7-d3801014a8c7 could not be found. Jun 16 00:34:26.137080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:26.137080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:26.137080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:26.137080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:26.137080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:26.137080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:26.137080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:34:26.137080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:34:26.137080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b227643-24e7-44b6-acf7-d3801014a8c7 could not be found. Jun 16 00:34:26.137080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:34:26.139043 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-52a79ec4-e0a3-41b0-a740-c861c68eefdd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Returning 404 to user: Instance 6b227643-24e7-44b6-acf7-d3801014a8c7 could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:26.139043 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-52a79ec4-e0a3-41b0-a740-c861c68eefdd tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 404 len: 111 microversion: 2.20 time: 0.032305 Jun 16 00:34:26.139043 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 408/798] 10.222.0.23 () {60 vars in 1279 bytes} [Thu Jun 16 00:34:26 2022] DELETE /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:34:26.144341 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-82d1df14-bab5-47da-823e-b55d9dec4b83 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:26.144970 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-82d1df14-bab5-47da-823e-b55d9dec4b83 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] [instance: 6b227643-24e7-44b6-acf7-d3801014a8c7] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:26.151678 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-82d1df14-bab5-47da-823e-b55d9dec4b83 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:26.152279 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-82d1df14-bab5-47da-823e-b55d9dec4b83 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:26.153226 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-82d1df14-bab5-47da-823e-b55d9dec4b83 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:26.153732 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-82d1df14-bab5-47da-823e-b55d9dec4b83 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:26.167375 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-82d1df14-bab5-47da-823e-b55d9dec4b83 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] HTTP exception thrown: Instance 6b227643-24e7-44b6-acf7-d3801014a8c7 could not be found. Jun 16 00:34:26.168946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-82d1df14-bab5-47da-823e-b55d9dec4b83 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Request method failure captured: Jun 16 00:34:26.168946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 HTTP/1.1 Jun 16 00:34:26.168946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:34:26.168946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:34:26.168946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:34:26.168946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:34:26.168946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:34:26.168946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:34:26.168946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:34:26.168946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:26.168946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnjkhYlnMQoJ6ll5DrxE3jVjof5ziwEcy_ENCJr9EqNSCv5ft04TUZZMBwQ1TNaX7gwedC-UXKiOJfwj-Zdfn04VMxb4f_qzjcrcCy16D8HNCbItqG2lNqbspZeOeulmf6LrG9KrmktpCZB5nBMoQF_kFqjoBnX9XETTs8rEZ7djSHI Jun 16 00:34:26.168946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:34:26.168946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:34:26.168946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:34:26.168946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:34:26.168946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 00:34:26.168946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:34:26.168946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:34:26.168946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: cd8526627add42a597eff6fce7400885 Jun 16 00:34:26.168946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-546813573 Jun 16 00:34:26.168946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:34:26.168946 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:34:26.170447 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cd8526627add42a597eff6fce7400885"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cd8526627add42a597eff6fce7400885"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd8526627add42a597eff6fce7400885"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd8526627add42a597eff6fce7400885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:34:26.170447 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-AttachVolumeShelveTestJSON-546813573 Jun 16 00:34:26.170447 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: cd8526627add42a597eff6fce7400885 Jun 16 00:34:26.170447 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-546813573 Jun 16 00:34:26.170447 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-AttachVolumeShelveTestJSON-546813573-project Jun 16 00:34:26.170447 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:34:26.170447 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:34:26.170447 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: f1d7bb8f9d364c5198313fedd982478a Jun 16 00:34:26.170447 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-AttachVolumeShelveTestJSON-546813573-project Jun 16 00:34:26.170447 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: > Jun 16 00:34:26.170447 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Instance 6b227643-24e7-44b6-acf7-d3801014a8c7 could not be found. Jun 16 00:34:26.170447 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'id': '6b227643-24e7-44b6-acf7-d3801014a8c7'} Jun 16 00:34:26.171331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:26.171331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:26.171331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:34:26.171331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:34:26.171331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:34:26.171331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:34:26.171331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:34:26.171331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:34:26.171331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:34:26.171331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:34:26.171331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b227643-24e7-44b6-acf7-d3801014a8c7 could not be found. Jun 16 00:34:26.171331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:26.171331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:26.171331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:26.171331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:26.171331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:26.171331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:26.171331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:26.171331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:26.171331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:26.172866 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:26.172866 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:34:26.172866 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:34:26.172866 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:34:26.172866 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:34:26.172866 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:34:26.172866 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:34:26.172866 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b227643-24e7-44b6-acf7-d3801014a8c7 could not be found. Jun 16 00:34:26.172866 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:26.172866 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:26.172866 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:26.172866 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:26.172866 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:26.172866 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:26.172866 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:34:26.172866 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:34:26.172866 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b227643-24e7-44b6-acf7-d3801014a8c7 could not be found. Jun 16 00:34:26.172866 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:34:26.174166 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-82d1df14-bab5-47da-823e-b55d9dec4b83 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] Returning 404 to user: Instance 6b227643-24e7-44b6-acf7-d3801014a8c7 could not be found. {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:26.174166 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-82d1df14-bab5-47da-823e-b55d9dec4b83 tempest-AttachVolumeShelveTestJSON-546813573 tempest-AttachVolumeShelveTestJSON-546813573-project] 10.222.0.23 "GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7" status: 404 len: 111 microversion: 2.20 time: 0.031716 Jun 16 00:34:26.174166 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 391/799] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Jun 16 00:34:26 2022] GET /compute/v2.1/servers/6b227643-24e7-44b6-acf7-d3801014a8c7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:34:44.973384 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-2d2ff9a6-d2df-4dc8-9fee-2bcbaafdf9bb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:44.974465 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-2d2ff9a6-d2df-4dc8-9fee-2bcbaafdf9bb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:44.976653 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:44.977719 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:44.983367 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2d2ff9a6-d2df-4dc8-9fee-2bcbaafdf9bb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:44.984494 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2d2ff9a6-d2df-4dc8-9fee-2bcbaafdf9bb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:44.985408 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2d2ff9a6-d2df-4dc8-9fee-2bcbaafdf9bb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:44.985727 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-2d2ff9a6-d2df-4dc8-9fee-2bcbaafdf9bb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:45.109662 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.objects.instance [None req-2d2ff9a6-d2df-4dc8-9fee-2bcbaafdf9bb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lazy-loading 'services' on Instance uuid 9fb9a660-6782-42cf-81df-8ac25aa4873d {{(pid=124231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:34:45.197180 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-2d2ff9a6-d2df-4dc8-9fee-2bcbaafdf9bb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d/os-volume_attachments/fc09c87b-8792-4052-b91c-fc7da3717df5" status: 202 len: 0 microversion: 2.1 time: 0.228719 Jun 16 00:34:45.198606 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 409/800] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Jun 16 00:34:44 2022] DELETE /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d/os-volume_attachments/fc09c87b-8792-4052-b91c-fc7da3717df5 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:34:46.329646 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-a82df3b6-de43-4aeb-9fdf-ed0c0604f481 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:34:46.332322 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:46.333025 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=23 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:46.339646 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a82df3b6-de43-4aeb-9fdf-ed0c0604f481 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:46.340094 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a82df3b6-de43-4aeb-9fdf-ed0c0604f481 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:46.362844 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-a82df3b6-de43-4aeb-9fdf-ed0c0604f481 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Going to try to stop instance {{(pid=124230) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 00:34:46.408054 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-a82df3b6-de43-4aeb-9fdf-ed0c0604f481 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "POST /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d/action" status: 202 len: 0 microversion: 2.1 time: 0.082651 Jun 16 00:34:46.408645 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 392/801] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Jun 16 00:34:46 2022] POST /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:34:46.417547 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-ebd3b317-95c4-46df-b27c-6cf56fa991f5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:46.418233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-ebd3b317-95c4-46df-b27c-6cf56fa991f5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:46.425379 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ebd3b317-95c4-46df-b27c-6cf56fa991f5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:46.425957 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ebd3b317-95c4-46df-b27c-6cf56fa991f5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:46.426582 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ebd3b317-95c4-46df-b27c-6cf56fa991f5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:46.427063 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ebd3b317-95c4-46df-b27c-6cf56fa991f5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:46.609288 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-ebd3b317-95c4-46df-b27c-6cf56fa991f5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:46.619344 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-ebd3b317-95c4-46df-b27c-6cf56fa991f5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1676 microversion: 2.1 time: 0.205653 Jun 16 00:34:46.629042 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 410/802] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:46 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1676 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:34:47.637721 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-ebb79f27-be94-4a73-87c4-374de7203310 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:47.638513 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-ebb79f27-be94-4a73-87c4-374de7203310 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:47.645218 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ebb79f27-be94-4a73-87c4-374de7203310 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:47.645674 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ebb79f27-be94-4a73-87c4-374de7203310 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:47.646476 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ebb79f27-be94-4a73-87c4-374de7203310 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:47.646915 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ebb79f27-be94-4a73-87c4-374de7203310 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:47.784813 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-ebb79f27-be94-4a73-87c4-374de7203310 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:47.792806 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-ebb79f27-be94-4a73-87c4-374de7203310 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1676 microversion: 2.1 time: 0.159871 Jun 16 00:34:47.793415 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 393/803] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:47 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:48.810341 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-69595ad3-a0c5-4df4-ac75-0e4710c8513f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:48.810973 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-69595ad3-a0c5-4df4-ac75-0e4710c8513f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:48.818035 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-69595ad3-a0c5-4df4-ac75-0e4710c8513f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:48.818491 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-69595ad3-a0c5-4df4-ac75-0e4710c8513f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:48.819249 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-69595ad3-a0c5-4df4-ac75-0e4710c8513f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:48.819661 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-69595ad3-a0c5-4df4-ac75-0e4710c8513f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:48.959349 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-69595ad3-a0c5-4df4-ac75-0e4710c8513f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:48.966825 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-69595ad3-a0c5-4df4-ac75-0e4710c8513f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1676 microversion: 2.1 time: 0.160614 Jun 16 00:34:48.967379 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 411/804] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:48 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:34:49.985003 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-0f901a6a-f16d-438d-9262-ffe35d1bed63 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:49.985603 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-0f901a6a-f16d-438d-9262-ffe35d1bed63 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:49.992107 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0f901a6a-f16d-438d-9262-ffe35d1bed63 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:49.992543 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0f901a6a-f16d-438d-9262-ffe35d1bed63 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:49.993383 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0f901a6a-f16d-438d-9262-ffe35d1bed63 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:49.993806 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0f901a6a-f16d-438d-9262-ffe35d1bed63 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:50.120998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0f901a6a-f16d-438d-9262-ffe35d1bed63 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:50.129484 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-0f901a6a-f16d-438d-9262-ffe35d1bed63 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1676 microversion: 2.1 time: 0.148467 Jun 16 00:34:50.130103 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 394/805] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:49 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:51.146215 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-9f5652bd-1796-488f-a28c-f775b5a242e0 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:51.146830 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-9f5652bd-1796-488f-a28c-f775b5a242e0 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:51.154967 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9f5652bd-1796-488f-a28c-f775b5a242e0 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:51.155436 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9f5652bd-1796-488f-a28c-f775b5a242e0 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:51.156239 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9f5652bd-1796-488f-a28c-f775b5a242e0 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:51.156676 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9f5652bd-1796-488f-a28c-f775b5a242e0 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:51.289627 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-9f5652bd-1796-488f-a28c-f775b5a242e0 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:51.298340 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-9f5652bd-1796-488f-a28c-f775b5a242e0 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1676 microversion: 2.1 time: 0.155880 Jun 16 00:34:51.298909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 412/806] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:51 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:52.316634 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-65042b24-e3df-468f-8b59-ee4cb3b35d0f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:52.318600 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-65042b24-e3df-468f-8b59-ee4cb3b35d0f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:52.325240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-65042b24-e3df-468f-8b59-ee4cb3b35d0f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:52.325772 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-65042b24-e3df-468f-8b59-ee4cb3b35d0f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:52.326541 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-65042b24-e3df-468f-8b59-ee4cb3b35d0f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:52.327150 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-65042b24-e3df-468f-8b59-ee4cb3b35d0f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:52.505261 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-65042b24-e3df-468f-8b59-ee4cb3b35d0f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:52.514382 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-65042b24-e3df-468f-8b59-ee4cb3b35d0f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1676 microversion: 2.1 time: 0.202269 Jun 16 00:34:52.516020 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 395/807] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:52 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1676 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:53.532540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-86804492-60a9-403c-86e9-5b8fd89a142d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:53.533172 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-86804492-60a9-403c-86e9-5b8fd89a142d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:53.539582 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-86804492-60a9-403c-86e9-5b8fd89a142d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:53.540022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-86804492-60a9-403c-86e9-5b8fd89a142d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:53.540777 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-86804492-60a9-403c-86e9-5b8fd89a142d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:53.541234 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-86804492-60a9-403c-86e9-5b8fd89a142d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:53.674561 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-86804492-60a9-403c-86e9-5b8fd89a142d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:53.682033 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-86804492-60a9-403c-86e9-5b8fd89a142d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1676 microversion: 2.1 time: 0.153889 Jun 16 00:34:53.682595 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 413/808] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:53 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:54.699212 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-bf0be2f4-60ad-4fdd-bce7-00d76c4f7667 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:54.699822 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-bf0be2f4-60ad-4fdd-bce7-00d76c4f7667 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:54.706158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bf0be2f4-60ad-4fdd-bce7-00d76c4f7667 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:54.706607 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bf0be2f4-60ad-4fdd-bce7-00d76c4f7667 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:54.707373 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bf0be2f4-60ad-4fdd-bce7-00d76c4f7667 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:54.707806 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bf0be2f4-60ad-4fdd-bce7-00d76c4f7667 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:54.993507 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-bf0be2f4-60ad-4fdd-bce7-00d76c4f7667 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:55.001664 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-bf0be2f4-60ad-4fdd-bce7-00d76c4f7667 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1676 microversion: 2.1 time: 0.306466 Jun 16 00:34:55.002241 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 396/809] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:54 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1676 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:56.020110 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-6b6b97f4-b7cb-4462-8be6-bfcf1d96acf9 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:56.020715 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-6b6b97f4-b7cb-4462-8be6-bfcf1d96acf9 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:56.027251 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6b6b97f4-b7cb-4462-8be6-bfcf1d96acf9 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:56.027697 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6b6b97f4-b7cb-4462-8be6-bfcf1d96acf9 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:56.028446 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6b6b97f4-b7cb-4462-8be6-bfcf1d96acf9 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:56.028906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6b6b97f4-b7cb-4462-8be6-bfcf1d96acf9 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:56.166182 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-6b6b97f4-b7cb-4462-8be6-bfcf1d96acf9 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:56.174412 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-6b6b97f4-b7cb-4462-8be6-bfcf1d96acf9 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1676 microversion: 2.1 time: 0.158497 Jun 16 00:34:56.175039 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 414/810] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:56 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:57.191389 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-a129d798-23ef-47fc-832f-344725ef48f1 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:57.191991 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-a129d798-23ef-47fc-832f-344725ef48f1 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:57.199185 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a129d798-23ef-47fc-832f-344725ef48f1 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:57.199628 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a129d798-23ef-47fc-832f-344725ef48f1 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:57.200383 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a129d798-23ef-47fc-832f-344725ef48f1 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:57.200812 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a129d798-23ef-47fc-832f-344725ef48f1 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:57.336367 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a129d798-23ef-47fc-832f-344725ef48f1 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:57.343871 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-a129d798-23ef-47fc-832f-344725ef48f1 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1653 microversion: 2.1 time: 0.156341 Jun 16 00:34:57.344422 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 397/811] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:57 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1653 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:57.361007 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-bca8c405-bbdf-4bd9-bcea-4282ea1e17d3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:34:57.367780 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-bca8c405-bbdf-4bd9-bcea-4282ea1e17d3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:57.368245 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-bca8c405-bbdf-4bd9-bcea-4282ea1e17d3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:57.393793 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-bca8c405-bbdf-4bd9-bcea-4282ea1e17d3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Going to try to start instance {{(pid=124231) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 00:34:57.435041 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-bca8c405-bbdf-4bd9-bcea-4282ea1e17d3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "POST /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d/action" status: 202 len: 0 microversion: 2.1 time: 0.078571 Jun 16 00:34:57.435563 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 415/812] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Jun 16 00:34:57 2022] POST /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:34:57.444310 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-7923d59e-820c-4aba-acd3-2fc277ffed33 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:57.444927 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-7923d59e-820c-4aba-acd3-2fc277ffed33 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:57.450880 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7923d59e-820c-4aba-acd3-2fc277ffed33 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:57.451326 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7923d59e-820c-4aba-acd3-2fc277ffed33 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:57.452750 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7923d59e-820c-4aba-acd3-2fc277ffed33 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:57.453201 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7923d59e-820c-4aba-acd3-2fc277ffed33 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:57.598364 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-7923d59e-820c-4aba-acd3-2fc277ffed33 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:57.605979 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-7923d59e-820c-4aba-acd3-2fc277ffed33 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1662 microversion: 2.1 time: 0.165488 Jun 16 00:34:57.606549 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 398/813] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:57 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1662 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:58.624351 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-04915eef-62ec-4d5e-82d5-4782aa0761ed tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:58.625170 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-04915eef-62ec-4d5e-82d5-4782aa0761ed tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:58.631342 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-04915eef-62ec-4d5e-82d5-4782aa0761ed tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:58.631840 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-04915eef-62ec-4d5e-82d5-4782aa0761ed tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:58.632600 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-04915eef-62ec-4d5e-82d5-4782aa0761ed tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:58.633099 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-04915eef-62ec-4d5e-82d5-4782aa0761ed tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:58.767191 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-04915eef-62ec-4d5e-82d5-4782aa0761ed tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:58.775440 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-04915eef-62ec-4d5e-82d5-4782aa0761ed tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1662 microversion: 2.1 time: 0.156177 Jun 16 00:34:58.776088 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 416/814] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:58 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1662 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:59.793949 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-14bf6874-73ca-4d76-9b19-ca87f818418f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:59.794502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-14bf6874-73ca-4d76-9b19-ca87f818418f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:59.801525 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-14bf6874-73ca-4d76-9b19-ca87f818418f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:59.801977 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-14bf6874-73ca-4d76-9b19-ca87f818418f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:59.802745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-14bf6874-73ca-4d76-9b19-ca87f818418f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:59.803185 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-14bf6874-73ca-4d76-9b19-ca87f818418f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:59.940581 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-14bf6874-73ca-4d76-9b19-ca87f818418f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:59.947997 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-14bf6874-73ca-4d76-9b19-ca87f818418f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1666 microversion: 2.1 time: 0.158031 Jun 16 00:34:59.948551 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 399/815] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:59 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1666 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:14.867564 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-8e7a8159-1ce6-40b7-903b-0ffe58ea5733 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-28757481", "imageRef": "d9a6de24-7a5e-4f8b-b078-809c87b15d56", "flavorRef": "452"}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:14.873773 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=16 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:14.874502 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:14.920900 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.network.neutron [None req-8e7a8159-1ce6-40b7-903b-0ffe58ea5733 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] validate_networks() for None {{(pid=124231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:35:15.199673 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-8e7a8159-1ce6-40b7-903b-0ffe58ea5733 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Flavor limits 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:35:15.200091 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-8e7a8159-1ce6-40b7-903b-0ffe58ea5733 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Image limits 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:35:15.200554 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-8e7a8159-1ce6-40b7-903b-0ffe58ea5733 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Flavor pref 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:35:15.200981 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-8e7a8159-1ce6-40b7-903b-0ffe58ea5733 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Image pref 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:35:15.201761 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-8e7a8159-1ce6-40b7-903b-0ffe58ea5733 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:35:15.210388 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8e7a8159-1ce6-40b7-903b-0ffe58ea5733 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:15.210770 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8e7a8159-1ce6-40b7-903b-0ffe58ea5733 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:15.211550 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8e7a8159-1ce6-40b7-903b-0ffe58ea5733 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:15.211972 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8e7a8159-1ce6-40b7-903b-0ffe58ea5733 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:15.228778 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-8e7a8159-1ce6-40b7-903b-0ffe58ea5733 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Getting quotas for project 841754b7d1914bcfa76aef0822c111ea. Resources: {'ram', 'cores', 'instances'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:35:15.233253 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-8e7a8159-1ce6-40b7-903b-0ffe58ea5733 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Getting quotas for user 9c053c25e4ad41cd9c398b7b1f44596d and project 841754b7d1914bcfa76aef0822c111ea. Resources: {'ram', 'cores', 'instances'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:35:15.243858 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-8e7a8159-1ce6-40b7-903b-0ffe58ea5733 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Going to run 1 instances... {{(pid=124231) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:35:15.246094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-8e7a8159-1ce6-40b7-903b-0ffe58ea5733 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] [instance: 1b670c26-5d02-4524-a625-c4cfc1a670ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d9a6de24-7a5e-4f8b-b078-809c87b15d56',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:35:15.289842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-8e7a8159-1ce6-40b7-903b-0ffe58ea5733 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.426109 Jun 16 00:35:15.290485 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 417/816] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Jun 16 00:35:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:35:15.299114 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=16 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:15.299867 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:15.304111 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-3d01bcf2-aaa5-4480-8c0e-f989994016c4 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:15.304730 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-3d01bcf2-aaa5-4480-8c0e-f989994016c4 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] [instance: 1b670c26-5d02-4524-a625-c4cfc1a670ee] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:15.362062 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-3d01bcf2-aaa5-4480-8c0e-f989994016c4 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c053c25e4ad41cd9c398b7b1f44596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841754b7d1914bcfa76aef0822c111ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:15.370255 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-3d01bcf2-aaa5-4480-8c0e-f989994016c4 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] 10.222.0.23 "GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee" status: 200 len: 1213 microversion: 2.1 time: 0.072728 Jun 16 00:35:15.370892 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 400/817] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:15 2022] GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:16.388675 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-cb7e86e3-6a0a-4726-8dca-aad105353fe5 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:16.389739 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-cb7e86e3-6a0a-4726-8dca-aad105353fe5 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] [instance: 1b670c26-5d02-4524-a625-c4cfc1a670ee] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:16.396893 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cb7e86e3-6a0a-4726-8dca-aad105353fe5 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:16.397349 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cb7e86e3-6a0a-4726-8dca-aad105353fe5 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:16.398102 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cb7e86e3-6a0a-4726-8dca-aad105353fe5 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:16.398527 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-cb7e86e3-6a0a-4726-8dca-aad105353fe5 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:16.464790 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-cb7e86e3-6a0a-4726-8dca-aad105353fe5 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c053c25e4ad41cd9c398b7b1f44596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841754b7d1914bcfa76aef0822c111ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:16.472409 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-cb7e86e3-6a0a-4726-8dca-aad105353fe5 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] 10.222.0.23 "GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee" status: 200 len: 1271 microversion: 2.1 time: 0.088865 Jun 16 00:35:16.473000 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 418/818] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:16 2022] GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:17.490196 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-1193f3f5-3576-4912-aa16-a54382f66177 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:17.491521 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-1193f3f5-3576-4912-aa16-a54382f66177 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] [instance: 1b670c26-5d02-4524-a625-c4cfc1a670ee] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:17.499921 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1193f3f5-3576-4912-aa16-a54382f66177 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:17.500392 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1193f3f5-3576-4912-aa16-a54382f66177 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:17.501338 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1193f3f5-3576-4912-aa16-a54382f66177 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:17.501857 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1193f3f5-3576-4912-aa16-a54382f66177 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:17.657297 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-1193f3f5-3576-4912-aa16-a54382f66177 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c053c25e4ad41cd9c398b7b1f44596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841754b7d1914bcfa76aef0822c111ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:17.668463 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-8ebe924c-7109-43c5-abb4-1c1d15120ed3 req-6f2f6ae5-be98-4afb-a69f-88c20cabd7fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b670c26-5d02-4524-a625-c4cfc1a670ee", "tag": "f9c48ea2-b9e5-46a5-9d28-92e7f400ea50"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:17.669849 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-1193f3f5-3576-4912-aa16-a54382f66177 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] 10.222.0.23 "GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee" status: 200 len: 1313 microversion: 2.1 time: 0.182434 Jun 16 00:35:17.680666 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 401/819] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:17 2022] GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:17.690438 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-8ebe924c-7109-43c5-abb4-1c1d15120ed3 req-6f2f6ae5-be98-4afb-a69f-88c20cabd7fa service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:17.690883 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-8ebe924c-7109-43c5-abb4-1c1d15120ed3 req-6f2f6ae5-be98-4afb-a69f-88c20cabd7fa service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:17.703591 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-8ebe924c-7109-43c5-abb4-1c1d15120ed3 req-6f2f6ae5-be98-4afb-a69f-88c20cabd7fa service nova] Creating event network-changed:f9c48ea2-b9e5-46a5-9d28-92e7f400ea50 for instance 1b670c26-5d02-4524-a625-c4cfc1a670ee on hv-cinder-84599 Jun 16 00:35:17.708923 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-8ebe924c-7109-43c5-abb4-1c1d15120ed3 req-6f2f6ae5-be98-4afb-a69f-88c20cabd7fa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051475 Jun 16 00:35:17.710390 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 419/820] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:18.686054 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-da305e97-a211-4147-b16c-add34997b71d tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:18.687279 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-da305e97-a211-4147-b16c-add34997b71d tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] [instance: 1b670c26-5d02-4524-a625-c4cfc1a670ee] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:18.693849 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-da305e97-a211-4147-b16c-add34997b71d tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:18.694301 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-da305e97-a211-4147-b16c-add34997b71d tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:18.695059 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-da305e97-a211-4147-b16c-add34997b71d tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:18.695494 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-da305e97-a211-4147-b16c-add34997b71d tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:18.822334 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-da305e97-a211-4147-b16c-add34997b71d tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c053c25e4ad41cd9c398b7b1f44596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841754b7d1914bcfa76aef0822c111ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:18.830361 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-da305e97-a211-4147-b16c-add34997b71d tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] 10.222.0.23 "GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee" status: 200 len: 1313 microversion: 2.1 time: 0.148154 Jun 16 00:35:18.830923 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 402/821] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:18 2022] GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:19.848295 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b1366e05-c100-46b0-9e3b-a7a998089a96 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:19.849082 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-b1366e05-c100-46b0-9e3b-a7a998089a96 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] [instance: 1b670c26-5d02-4524-a625-c4cfc1a670ee] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:19.855357 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b1366e05-c100-46b0-9e3b-a7a998089a96 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:19.855798 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b1366e05-c100-46b0-9e3b-a7a998089a96 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:19.856540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b1366e05-c100-46b0-9e3b-a7a998089a96 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:19.856996 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b1366e05-c100-46b0-9e3b-a7a998089a96 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:19.987255 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-b1366e05-c100-46b0-9e3b-a7a998089a96 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c053c25e4ad41cd9c398b7b1f44596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841754b7d1914bcfa76aef0822c111ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:19.994689 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-b1366e05-c100-46b0-9e3b-a7a998089a96 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] 10.222.0.23 "GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee" status: 200 len: 1313 microversion: 2.1 time: 0.151021 Jun 16 00:35:19.995259 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 420/822] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:19 2022] GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:21.010886 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-1e899d1c-034d-48fe-8f64-e1912b18a9b4 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:21.011552 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-1e899d1c-034d-48fe-8f64-e1912b18a9b4 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] [instance: 1b670c26-5d02-4524-a625-c4cfc1a670ee] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:21.018722 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1e899d1c-034d-48fe-8f64-e1912b18a9b4 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:21.019161 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1e899d1c-034d-48fe-8f64-e1912b18a9b4 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:21.019904 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1e899d1c-034d-48fe-8f64-e1912b18a9b4 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:21.020329 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1e899d1c-034d-48fe-8f64-e1912b18a9b4 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:21.149182 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-1e899d1c-034d-48fe-8f64-e1912b18a9b4 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c053c25e4ad41cd9c398b7b1f44596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841754b7d1914bcfa76aef0822c111ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:21.157383 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-1e899d1c-034d-48fe-8f64-e1912b18a9b4 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] 10.222.0.23 "GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee" status: 200 len: 1313 microversion: 2.1 time: 0.150415 Jun 16 00:35:21.157960 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 403/823] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:21 2022] GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:22.173500 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-16e8ee59-f892-4bcf-86ab-4a5f528e9aae tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:22.174171 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-16e8ee59-f892-4bcf-86ab-4a5f528e9aae tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] [instance: 1b670c26-5d02-4524-a625-c4cfc1a670ee] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:22.181064 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-16e8ee59-f892-4bcf-86ab-4a5f528e9aae tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:22.181511 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-16e8ee59-f892-4bcf-86ab-4a5f528e9aae tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:22.182265 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-16e8ee59-f892-4bcf-86ab-4a5f528e9aae tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:22.182689 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-16e8ee59-f892-4bcf-86ab-4a5f528e9aae tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:22.257083 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-88f2dfa1-6175-4ca6-b247-7e411a3c103b req-cc9ac13e-72c0-4186-92e5-ef4dd54c97c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b670c26-5d02-4524-a625-c4cfc1a670ee", "name": "network-vif-plugged", "status": "completed", "tag": "f9c48ea2-b9e5-46a5-9d28-92e7f400ea50"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:22.272366 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-88f2dfa1-6175-4ca6-b247-7e411a3c103b req-cc9ac13e-72c0-4186-92e5-ef4dd54c97c3 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:22.273043 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-88f2dfa1-6175-4ca6-b247-7e411a3c103b req-cc9ac13e-72c0-4186-92e5-ef4dd54c97c3 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:22.284932 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-88f2dfa1-6175-4ca6-b247-7e411a3c103b req-cc9ac13e-72c0-4186-92e5-ef4dd54c97c3 service nova] Creating event network-vif-plugged:f9c48ea2-b9e5-46a5-9d28-92e7f400ea50 for instance 1b670c26-5d02-4524-a625-c4cfc1a670ee on hv-cinder-84599 Jun 16 00:35:22.290428 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-88f2dfa1-6175-4ca6-b247-7e411a3c103b req-cc9ac13e-72c0-4186-92e5-ef4dd54c97c3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037118 Jun 16 00:35:22.291579 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 404/824] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:35:22.322900 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-16e8ee59-f892-4bcf-86ab-4a5f528e9aae tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c053c25e4ad41cd9c398b7b1f44596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841754b7d1914bcfa76aef0822c111ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:22.334308 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-16e8ee59-f892-4bcf-86ab-4a5f528e9aae tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] 10.222.0.23 "GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee" status: 200 len: 1313 microversion: 2.1 time: 0.164623 Jun 16 00:35:22.334888 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 421/825] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:22 2022] GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:23.351936 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-31ebf023-3fa8-4a54-ab52-ac3ff43792c1 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:23.352622 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-31ebf023-3fa8-4a54-ab52-ac3ff43792c1 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] [instance: 1b670c26-5d02-4524-a625-c4cfc1a670ee] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:23.358777 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-31ebf023-3fa8-4a54-ab52-ac3ff43792c1 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:23.359216 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-31ebf023-3fa8-4a54-ab52-ac3ff43792c1 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:23.359963 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-31ebf023-3fa8-4a54-ab52-ac3ff43792c1 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:23.360388 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-31ebf023-3fa8-4a54-ab52-ac3ff43792c1 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:23.491323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-31ebf023-3fa8-4a54-ab52-ac3ff43792c1 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c053c25e4ad41cd9c398b7b1f44596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841754b7d1914bcfa76aef0822c111ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:23.499323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-31ebf023-3fa8-4a54-ab52-ac3ff43792c1 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] 10.222.0.23 "GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee" status: 200 len: 1313 microversion: 2.1 time: 0.151531 Jun 16 00:35:23.499974 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 405/826] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:23 2022] GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:24.514946 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-7159e172-f08c-4b3e-ade4-ae013fefd9a3 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:24.515815 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-7159e172-f08c-4b3e-ade4-ae013fefd9a3 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] [instance: 1b670c26-5d02-4524-a625-c4cfc1a670ee] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:24.522428 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7159e172-f08c-4b3e-ade4-ae013fefd9a3 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:24.522855 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7159e172-f08c-4b3e-ade4-ae013fefd9a3 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:24.523612 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7159e172-f08c-4b3e-ade4-ae013fefd9a3 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:24.524059 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7159e172-f08c-4b3e-ade4-ae013fefd9a3 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:24.654041 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-7159e172-f08c-4b3e-ade4-ae013fefd9a3 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c053c25e4ad41cd9c398b7b1f44596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841754b7d1914bcfa76aef0822c111ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:24.664146 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-7159e172-f08c-4b3e-ade4-ae013fefd9a3 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] 10.222.0.23 "GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee" status: 200 len: 1463 microversion: 2.1 time: 0.153045 Jun 16 00:35:24.664715 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 422/827] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:24 2022] GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee => generated 1463 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:24.705232 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-be38cb4b-db36-4e23-81b9-fad0204ff81c tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:24.705733 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-be38cb4b-db36-4e23-81b9-fad0204ff81c tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] [instance: 1b670c26-5d02-4524-a625-c4cfc1a670ee] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:24.712233 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-be38cb4b-db36-4e23-81b9-fad0204ff81c tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:24.712679 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-be38cb4b-db36-4e23-81b9-fad0204ff81c tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:24.713492 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-be38cb4b-db36-4e23-81b9-fad0204ff81c tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:24.713921 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-be38cb4b-db36-4e23-81b9-fad0204ff81c tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:24.740770 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-be38cb4b-db36-4e23-81b9-fad0204ff81c tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] [instance: 1b670c26-5d02-4524-a625-c4cfc1a670ee] Going to try to terminate instance {{(pid=124230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:35:24.822207 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-be38cb4b-db36-4e23-81b9-fad0204ff81c tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee" status: 204 len: 0 microversion: 2.1 time: 0.121099 Jun 16 00:35:24.822965 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 406/828] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:35:24 2022] DELETE /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:35:24.832399 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b0151891-bdfe-41ad-844d-fda9073b2485 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:24.833026 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-b0151891-bdfe-41ad-844d-fda9073b2485 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] [instance: 1b670c26-5d02-4524-a625-c4cfc1a670ee] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:24.838966 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b0151891-bdfe-41ad-844d-fda9073b2485 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:24.839412 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b0151891-bdfe-41ad-844d-fda9073b2485 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:24.840162 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b0151891-bdfe-41ad-844d-fda9073b2485 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:24.840590 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b0151891-bdfe-41ad-844d-fda9073b2485 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:24.979924 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-b0151891-bdfe-41ad-844d-fda9073b2485 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c053c25e4ad41cd9c398b7b1f44596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841754b7d1914bcfa76aef0822c111ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:24.987707 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-b0151891-bdfe-41ad-844d-fda9073b2485 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] 10.222.0.23 "GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee" status: 200 len: 1469 microversion: 2.1 time: 0.159139 Jun 16 00:35:24.988279 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 423/829] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:24 2022] GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:26.006808 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5f5684b1-7e26-4857-8b8e-3c3d3d10a183 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:26.007415 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-5f5684b1-7e26-4857-8b8e-3c3d3d10a183 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] [instance: 1b670c26-5d02-4524-a625-c4cfc1a670ee] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:26.009410 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=2 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:26.015641 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5f5684b1-7e26-4857-8b8e-3c3d3d10a183 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:26.016088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5f5684b1-7e26-4857-8b8e-3c3d3d10a183 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:26.016848 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5f5684b1-7e26-4857-8b8e-3c3d3d10a183 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:26.017304 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5f5684b1-7e26-4857-8b8e-3c3d3d10a183 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:26.145827 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-5f5684b1-7e26-4857-8b8e-3c3d3d10a183 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c053c25e4ad41cd9c398b7b1f44596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841754b7d1914bcfa76aef0822c111ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:26.153653 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-5f5684b1-7e26-4857-8b8e-3c3d3d10a183 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] 10.222.0.23 "GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee" status: 200 len: 1469 microversion: 2.1 time: 0.151142 Jun 16 00:35:26.154246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 407/830] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:26 2022] GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:26.772783 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-71fdb631-742b-4310-a239-88ac88f21ada req-1086c832-538f-443b-b219-97bc00e53b3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b670c26-5d02-4524-a625-c4cfc1a670ee", "name": "network-vif-deleted", "tag": "f9c48ea2-b9e5-46a5-9d28-92e7f400ea50"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:26.776895 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=2 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:26.777608 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=6 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:26.785539 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-71fdb631-742b-4310-a239-88ac88f21ada req-1086c832-538f-443b-b219-97bc00e53b3a service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:26.786215 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-71fdb631-742b-4310-a239-88ac88f21ada req-1086c832-538f-443b-b219-97bc00e53b3a service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:26.800404 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-71fdb631-742b-4310-a239-88ac88f21ada req-1086c832-538f-443b-b219-97bc00e53b3a service nova] Creating event network-vif-deleted:f9c48ea2-b9e5-46a5-9d28-92e7f400ea50 for instance 1b670c26-5d02-4524-a625-c4cfc1a670ee on hv-cinder-84599 Jun 16 00:35:26.805235 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-71fdb631-742b-4310-a239-88ac88f21ada req-1086c832-538f-443b-b219-97bc00e53b3a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036013 Jun 16 00:35:26.805825 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 424/831] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:27.172745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-3fb55eff-468f-4603-bd92-c86c1c209d73 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:27.173405 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-3fb55eff-468f-4603-bd92-c86c1c209d73 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] [instance: 1b670c26-5d02-4524-a625-c4cfc1a670ee] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:27.179888 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3fb55eff-468f-4603-bd92-c86c1c209d73 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:27.180340 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3fb55eff-468f-4603-bd92-c86c1c209d73 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:27.181146 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3fb55eff-468f-4603-bd92-c86c1c209d73 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:27.181577 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3fb55eff-468f-4603-bd92-c86c1c209d73 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:27.219274 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3fb55eff-468f-4603-bd92-c86c1c209d73 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:27.219810 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3fb55eff-468f-4603-bd92-c86c1c209d73 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:27.220240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.objects.instance [None req-3fb55eff-468f-4603-bd92-c86c1c209d73 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lazy-loading 'fault' on Instance uuid 1b670c26-5d02-4524-a625-c4cfc1a670ee {{(pid=124230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:35:27.264854 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-3fb55eff-468f-4603-bd92-c86c1c209d73 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c053c25e4ad41cd9c398b7b1f44596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841754b7d1914bcfa76aef0822c111ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:27.273856 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-3fb55eff-468f-4603-bd92-c86c1c209d73 tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] 10.222.0.23 "GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee" status: 200 len: 1303 microversion: 2.1 time: 0.106544 Jun 16 00:35:27.274418 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 408/832] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:27 2022] GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:28.292312 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-0247470b-1c85-498b-b456-4e2ee5f1594e tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:28.293042 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-0247470b-1c85-498b-b456-4e2ee5f1594e tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] [instance: 1b670c26-5d02-4524-a625-c4cfc1a670ee] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:28.299955 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0247470b-1c85-498b-b456-4e2ee5f1594e tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:28.300401 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0247470b-1c85-498b-b456-4e2ee5f1594e tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:28.301204 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0247470b-1c85-498b-b456-4e2ee5f1594e tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:28.301635 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0247470b-1c85-498b-b456-4e2ee5f1594e tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:28.314755 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-0247470b-1c85-498b-b456-4e2ee5f1594e tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] HTTP exception thrown: Instance 1b670c26-5d02-4524-a625-c4cfc1a670ee could not be found. Jun 16 00:35:28.316371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-0247470b-1c85-498b-b456-4e2ee5f1594e tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Request method failure captured: Jun 16 00:35:28.316371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee HTTP/1.1 Jun 16 00:35:28.316371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:35:28.316371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:35:28.316371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:35:28.316371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:35:28.316371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:35:28.316371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:35:28.316371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:35:28.316371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:35:28.316371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnrBzTitEskNF8V54batUtGpQRz2HTHtHjxU3BLO_sn7oyal_tR8uMrkQnavE6B0748no_AsopFgsiHanDJ_H2KtsFyVSC8UPpLhssEngRJz7affjUOSbTwGLrGceIWBdOD6YDoZIvveqNintJwkmZJyS91SDqTmCx4CP5p6rhJV9JU Jun 16 00:35:28.316371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:35:28.316371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:35:28.316371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:35:28.316371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:35:28.316371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:35:28.316371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:35:28.316371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: 841754b7d1914bcfa76aef0822c111ea Jun 16 00:35:28.316371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-VolumesNegativeTest-1702997573 Jun 16 00:35:28.316371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:35:28.316371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:35:28.318057 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_841754b7d1914bcfa76aef0822c111ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/841754b7d1914bcfa76aef0822c111ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/841754b7d1914bcfa76aef0822c111ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/841754b7d1914bcfa76aef0822c111ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:35:28.318057 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-VolumesNegativeTest-1702997573 Jun 16 00:35:28.318057 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: 841754b7d1914bcfa76aef0822c111ea Jun 16 00:35:28.318057 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-VolumesNegativeTest-1702997573 Jun 16 00:35:28.318057 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-VolumesNegativeTest-1702997573-project Jun 16 00:35:28.318057 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:35:28.318057 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:35:28.318057 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: 9c053c25e4ad41cd9c398b7b1f44596d Jun 16 00:35:28.318057 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-VolumesNegativeTest-1702997573-project Jun 16 00:35:28.318057 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:35:28.318057 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Instance 1b670c26-5d02-4524-a625-c4cfc1a670ee could not be found. Jun 16 00:35:28.318057 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': '1b670c26-5d02-4524-a625-c4cfc1a670ee'} Jun 16 00:35:28.319131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:35:28.319131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:35:28.319131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:35:28.319131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:35:28.319131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:35:28.319131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:35:28.319131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:35:28.319131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:35:28.319131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:35:28.319131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:35:28.319131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b670c26-5d02-4524-a625-c4cfc1a670ee could not be found. Jun 16 00:35:28.319131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:35:28.319131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:35:28.319131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:35:28.319131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:35:28.319131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:35:28.319131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:35:28.319131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:35:28.319131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:35:28.319131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:35:28.320722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:35:28.320722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:35:28.320722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:35:28.320722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:35:28.320722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:35:28.320722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:35:28.320722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:35:28.320722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b670c26-5d02-4524-a625-c4cfc1a670ee could not be found. Jun 16 00:35:28.320722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:35:28.320722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:35:28.320722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:35:28.320722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:35:28.320722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:35:28.320722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:35:28.320722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:35:28.320722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:35:28.320722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b670c26-5d02-4524-a625-c4cfc1a670ee could not be found. Jun 16 00:35:28.320722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:35:28.322786 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-0247470b-1c85-498b-b456-4e2ee5f1594e tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] Returning 404 to user: Instance 1b670c26-5d02-4524-a625-c4cfc1a670ee could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:35:28.322786 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-0247470b-1c85-498b-b456-4e2ee5f1594e tempest-VolumesNegativeTest-1702997573 tempest-VolumesNegativeTest-1702997573-project] 10.222.0.23 "GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee" status: 404 len: 111 microversion: 2.1 time: 0.030133 Jun 16 00:35:28.322786 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 425/833] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:28 2022] GET /compute/v2.1/servers/1b670c26-5d02-4524-a625-c4cfc1a670ee => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:35:35.419206 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-be90fc96-7f42-45d1-8f14-79456012489c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:35.420304 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-be90fc96-7f42-45d1-8f14-79456012489c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:35.423257 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-339193ba-aa61-4e4b-bd4b-525298a441c2 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1879382363", "imageRef": "d9a6de24-7a5e-4f8b-b078-809c87b15d56", "flavorRef": "452", "networks": [{"uuid": "5f0f190e-1ad8-461e-95ff-976dcb7a032c"}]}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:35.427262 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-be90fc96-7f42-45d1-8f14-79456012489c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:35.427709 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-be90fc96-7f42-45d1-8f14-79456012489c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:35.428468 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-be90fc96-7f42-45d1-8f14-79456012489c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:35.428915 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-be90fc96-7f42-45d1-8f14-79456012489c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:35.458463 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-be90fc96-7f42-45d1-8f14-79456012489c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043312 Jun 16 00:35:35.459008 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 409/834] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Jun 16 00:35:35 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:35:35.476022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.network.neutron [None req-339193ba-aa61-4e4b-bd4b-525298a441c2 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] validate_networks() for [('5f0f190e-1ad8-461e-95ff-976dcb7a032c', None, None, None, None, None)] {{(pid=124231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:35:35.518966 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b90a20bc-6e43-43d7-aab7-9455643af0af tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:35.519502 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-b90a20bc-6e43-43d7-aab7-9455643af0af tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:35.525797 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b90a20bc-6e43-43d7-aab7-9455643af0af tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:35.526248 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b90a20bc-6e43-43d7-aab7-9455643af0af tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:35.527027 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b90a20bc-6e43-43d7-aab7-9455643af0af tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:35.527459 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b90a20bc-6e43-43d7-aab7-9455643af0af tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:35.557464 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-b90a20bc-6e43-43d7-aab7-9455643af0af tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Going to try to terminate instance {{(pid=124230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:35:35.643147 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-b90a20bc-6e43-43d7-aab7-9455643af0af tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 204 len: 0 microversion: 2.1 time: 0.129141 Jun 16 00:35:35.644126 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 410/835] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:35:35 2022] DELETE /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 00:35:35.653054 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-14079253-d6aa-4e49-aa60-c1cb7929c91d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:35.653757 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-14079253-d6aa-4e49-aa60-c1cb7929c91d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:35.660570 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-14079253-d6aa-4e49-aa60-c1cb7929c91d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:35.661234 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-14079253-d6aa-4e49-aa60-c1cb7929c91d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:35.661931 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-14079253-d6aa-4e49-aa60-c1cb7929c91d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:35.662444 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-14079253-d6aa-4e49-aa60-c1cb7929c91d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:35.806436 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-14079253-d6aa-4e49-aa60-c1cb7929c91d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:35.815214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-14079253-d6aa-4e49-aa60-c1cb7929c91d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1672 microversion: 2.1 time: 0.166512 Jun 16 00:35:35.815997 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 411/836] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:35 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:36.074151 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-339193ba-aa61-4e4b-bd4b-525298a441c2 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Flavor limits 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:35:36.074569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-339193ba-aa61-4e4b-bd4b-525298a441c2 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Image limits 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:35:36.075035 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-339193ba-aa61-4e4b-bd4b-525298a441c2 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Flavor pref 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:35:36.075444 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-339193ba-aa61-4e4b-bd4b-525298a441c2 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Image pref 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:35:36.075854 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-339193ba-aa61-4e4b-bd4b-525298a441c2 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:35:36.085279 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-339193ba-aa61-4e4b-bd4b-525298a441c2 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:36.085728 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-339193ba-aa61-4e4b-bd4b-525298a441c2 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:36.086517 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-339193ba-aa61-4e4b-bd4b-525298a441c2 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:36.086949 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-339193ba-aa61-4e4b-bd4b-525298a441c2 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:36.103625 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-339193ba-aa61-4e4b-bd4b-525298a441c2 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Getting quotas for project 8dd0505146da40efbb028199390f8c75. Resources: {'ram', 'cores', 'instances'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:35:36.108508 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-339193ba-aa61-4e4b-bd4b-525298a441c2 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Getting quotas for user f77cfd6c2be6487e9701e08340c6c792 and project 8dd0505146da40efbb028199390f8c75. Resources: {'ram', 'cores', 'instances'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:35:36.119234 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-339193ba-aa61-4e4b-bd4b-525298a441c2 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Going to run 1 instances... {{(pid=124231) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:35:36.121492 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-339193ba-aa61-4e4b-bd4b-525298a441c2 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 00ed7f8e-6608-40b3-81a1-31e9aa723fcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d9a6de24-7a5e-4f8b-b078-809c87b15d56',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:35:36.167833 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-339193ba-aa61-4e4b-bd4b-525298a441c2 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748476 Jun 16 00:35:36.168470 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 426/837] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Jun 16 00:35:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 00:35:36.179401 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c29f23a4-9b8c-43b8-8f76-a2d7a93d9b18 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:36.180169 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c29f23a4-9b8c-43b8-8f76-a2d7a93d9b18 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 00ed7f8e-6608-40b3-81a1-31e9aa723fcf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:36.234350 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c29f23a4-9b8c-43b8-8f76-a2d7a93d9b18 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:36.241153 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c29f23a4-9b8c-43b8-8f76-a2d7a93d9b18 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf" status: 200 len: 1219 microversion: 2.1 time: 0.065653 Jun 16 00:35:36.241711 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 412/838] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:36 2022] GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:36.832813 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-11fb7d7d-eed3-4a1a-a944-8e57adcf71b8 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:36.833453 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-11fb7d7d-eed3-4a1a-a944-8e57adcf71b8 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:36.839826 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-11fb7d7d-eed3-4a1a-a944-8e57adcf71b8 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:36.840272 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-11fb7d7d-eed3-4a1a-a944-8e57adcf71b8 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:36.841176 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-11fb7d7d-eed3-4a1a-a944-8e57adcf71b8 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:36.842025 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-11fb7d7d-eed3-4a1a-a944-8e57adcf71b8 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:36.989748 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-11fb7d7d-eed3-4a1a-a944-8e57adcf71b8 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:36.997157 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-11fb7d7d-eed3-4a1a-a944-8e57adcf71b8 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1672 microversion: 2.1 time: 0.168675 Jun 16 00:35:36.998330 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 427/839] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:36 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:37.258715 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-bf72f75e-b05f-4129-a4fc-3b04a63e2bbf tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:37.259286 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-bf72f75e-b05f-4129-a4fc-3b04a63e2bbf tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 00ed7f8e-6608-40b3-81a1-31e9aa723fcf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:37.266480 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bf72f75e-b05f-4129-a4fc-3b04a63e2bbf tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:37.266925 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bf72f75e-b05f-4129-a4fc-3b04a63e2bbf tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:37.267684 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bf72f75e-b05f-4129-a4fc-3b04a63e2bbf tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:37.268113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bf72f75e-b05f-4129-a4fc-3b04a63e2bbf tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:37.331625 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-bf72f75e-b05f-4129-a4fc-3b04a63e2bbf tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:37.339038 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-bf72f75e-b05f-4129-a4fc-3b04a63e2bbf tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf" status: 200 len: 1223 microversion: 2.1 time: 0.084311 Jun 16 00:35:37.339585 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 413/840] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:37 2022] GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:38.015997 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-ddad2122-4903-4472-a7dc-d5738fb04d3f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:38.016600 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-ddad2122-4903-4472-a7dc-d5738fb04d3f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:38.023886 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ddad2122-4903-4472-a7dc-d5738fb04d3f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:38.024336 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ddad2122-4903-4472-a7dc-d5738fb04d3f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:38.025137 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ddad2122-4903-4472-a7dc-d5738fb04d3f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:38.025573 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ddad2122-4903-4472-a7dc-d5738fb04d3f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:38.265189 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-ddad2122-4903-4472-a7dc-d5738fb04d3f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:38.274520 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-ddad2122-4903-4472-a7dc-d5738fb04d3f tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1672 microversion: 2.1 time: 0.263335 Jun 16 00:35:38.285468 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 428/841] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:38 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1672 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:38.356760 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-0bea193a-0230-461c-8872-38547c2f346b tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:38.358197 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-0bea193a-0230-461c-8872-38547c2f346b tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 00ed7f8e-6608-40b3-81a1-31e9aa723fcf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:38.365252 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0bea193a-0230-461c-8872-38547c2f346b tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:38.365699 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0bea193a-0230-461c-8872-38547c2f346b tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:38.366463 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0bea193a-0230-461c-8872-38547c2f346b tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:38.367039 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0bea193a-0230-461c-8872-38547c2f346b tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:38.467335 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0bea193a-0230-461c-8872-38547c2f346b tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:38.475551 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-0bea193a-0230-461c-8872-38547c2f346b tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf" status: 200 len: 1277 microversion: 2.1 time: 0.122775 Jun 16 00:35:38.476118 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 414/842] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:38 2022] GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:38.913289 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-25fab716-0b9a-4f07-903d-5f6d96668377 req-7d97c5e8-714c-4e08-b9e7-d2a040e8cf31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fb9a660-6782-42cf-81df-8ac25aa4873d", "name": "network-vif-deleted", "tag": "d246edbd-026a-4123-b145-fbc1e391af34"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:38.922227 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-25fab716-0b9a-4f07-903d-5f6d96668377 req-7d97c5e8-714c-4e08-b9e7-d2a040e8cf31 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:38.922926 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-25fab716-0b9a-4f07-903d-5f6d96668377 req-7d97c5e8-714c-4e08-b9e7-d2a040e8cf31 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:38.945190 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-25fab716-0b9a-4f07-903d-5f6d96668377 req-7d97c5e8-714c-4e08-b9e7-d2a040e8cf31 service nova] Creating event network-vif-deleted:d246edbd-026a-4123-b145-fbc1e391af34 for instance 9fb9a660-6782-42cf-81df-8ac25aa4873d on hv-cinder-84599 Jun 16 00:35:38.953498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-25fab716-0b9a-4f07-903d-5f6d96668377 req-7d97c5e8-714c-4e08-b9e7-d2a040e8cf31 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041753 Jun 16 00:35:38.955152 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 429/843] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:39.292399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-4d6f9f3d-0779-40db-b599-17b312eb6218 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:39.293217 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-4d6f9f3d-0779-40db-b599-17b312eb6218 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:39.299861 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4d6f9f3d-0779-40db-b599-17b312eb6218 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:39.300493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4d6f9f3d-0779-40db-b599-17b312eb6218 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:39.301426 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4d6f9f3d-0779-40db-b599-17b312eb6218 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:39.302011 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4d6f9f3d-0779-40db-b599-17b312eb6218 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:39.327840 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:39.351215 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4d6f9f3d-0779-40db-b599-17b312eb6218 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:39.351932 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4d6f9f3d-0779-40db-b599-17b312eb6218 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:39.352722 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.objects.instance [None req-4d6f9f3d-0779-40db-b599-17b312eb6218 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lazy-loading 'fault' on Instance uuid 9fb9a660-6782-42cf-81df-8ac25aa4873d {{(pid=124230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:35:39.446804 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-4d6f9f3d-0779-40db-b599-17b312eb6218 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:39.459687 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-4d6f9f3d-0779-40db-b599-17b312eb6218 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 200 len: 1327 microversion: 2.1 time: 0.171256 Jun 16 00:35:39.461036 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 415/844] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:39 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 1327 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:39.498170 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-248a09cc-bb01-4f52-ae35-87e1fe1f30a1 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:39.500906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-248a09cc-bb01-4f52-ae35-87e1fe1f30a1 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 00ed7f8e-6608-40b3-81a1-31e9aa723fcf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:39.516737 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-248a09cc-bb01-4f52-ae35-87e1fe1f30a1 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:39.517771 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-248a09cc-bb01-4f52-ae35-87e1fe1f30a1 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:39.519961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-248a09cc-bb01-4f52-ae35-87e1fe1f30a1 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:39.521214 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-248a09cc-bb01-4f52-ae35-87e1fe1f30a1 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:39.652593 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-de5a4f93-64d9-4a14-8ee7-877bf08bd228 req-556147c2-6d24-48af-9bdc-a0badec46dba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00ed7f8e-6608-40b3-81a1-31e9aa723fcf", "tag": "11a7ff88-7ccf-4a7c-a210-379711f1e7bb"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:39.672396 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-de5a4f93-64d9-4a14-8ee7-877bf08bd228 req-556147c2-6d24-48af-9bdc-a0badec46dba service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:39.673644 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-de5a4f93-64d9-4a14-8ee7-877bf08bd228 req-556147c2-6d24-48af-9bdc-a0badec46dba service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:39.686477 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-de5a4f93-64d9-4a14-8ee7-877bf08bd228 req-556147c2-6d24-48af-9bdc-a0badec46dba service nova] Creating event network-changed:11a7ff88-7ccf-4a7c-a210-379711f1e7bb for instance 00ed7f8e-6608-40b3-81a1-31e9aa723fcf on hv-cinder-84599 Jun 16 00:35:39.691654 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-de5a4f93-64d9-4a14-8ee7-877bf08bd228 req-556147c2-6d24-48af-9bdc-a0badec46dba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043313 Jun 16 00:35:39.692256 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 416/845] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:39.710575 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-248a09cc-bb01-4f52-ae35-87e1fe1f30a1 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:39.719201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-248a09cc-bb01-4f52-ae35-87e1fe1f30a1 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf" status: 200 len: 1319 microversion: 2.1 time: 0.228254 Jun 16 00:35:39.720030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 430/846] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:39 2022] GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:40.486158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-34358c13-c9e1-4506-bdb8-a33b19045d0c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:40.486846 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-34358c13-c9e1-4506-bdb8-a33b19045d0c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:40.493009 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-34358c13-c9e1-4506-bdb8-a33b19045d0c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:40.493451 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-34358c13-c9e1-4506-bdb8-a33b19045d0c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:40.494197 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-34358c13-c9e1-4506-bdb8-a33b19045d0c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:40.494626 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-34358c13-c9e1-4506-bdb8-a33b19045d0c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:40.508105 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-34358c13-c9e1-4506-bdb8-a33b19045d0c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] HTTP exception thrown: Instance 9fb9a660-6782-42cf-81df-8ac25aa4873d could not be found. Jun 16 00:35:40.509745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-34358c13-c9e1-4506-bdb8-a33b19045d0c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Request method failure captured: Jun 16 00:35:40.509745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d HTTP/1.1 Jun 16 00:35:40.509745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:35:40.509745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:35:40.509745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:35:40.509745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:35:40.509745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:35:40.509745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:35:40.509745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:35:40.509745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:35:40.509745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnoohqT51d1Og861drBVM1xT3p_YO-9Ywiwgdfnk41ZHtqwaCkHblNwVf0CcDS17ycAX4Q7GuugzikdHEKZC3dJA4z2IEyNcGKiMAYGoC7Gn6zonVVDjLc6O2cmS2ChJDYIUrCysOkv-f1SqjTvRN_64xm0mUUK9wpDNigH52-7iWLo Jun 16 00:35:40.509745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:35:40.509745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:35:40.509745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:35:40.509745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:35:40.509745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:35:40.509745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:35:40.509745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: d2cc2e1e741d4eeb849e07d9f2c371be Jun 16 00:35:40.509745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-AttachVolumeTestJSON-174631568 Jun 16 00:35:40.509745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:35:40.509745 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:35:40.512552 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:35:40.512552 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-AttachVolumeTestJSON-174631568 Jun 16 00:35:40.512552 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: d2cc2e1e741d4eeb849e07d9f2c371be Jun 16 00:35:40.512552 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-AttachVolumeTestJSON-174631568 Jun 16 00:35:40.512552 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-AttachVolumeTestJSON-174631568-project Jun 16 00:35:40.512552 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:35:40.512552 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:35:40.512552 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: d5985474b0774d8ea0e62718de767310 Jun 16 00:35:40.512552 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-AttachVolumeTestJSON-174631568-project Jun 16 00:35:40.512552 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: > Jun 16 00:35:40.512552 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Instance 9fb9a660-6782-42cf-81df-8ac25aa4873d could not be found. Jun 16 00:35:40.512552 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'id': '9fb9a660-6782-42cf-81df-8ac25aa4873d'} Jun 16 00:35:40.514158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:35:40.514158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:35:40.514158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:35:40.514158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:35:40.514158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:35:40.514158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:35:40.514158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:35:40.514158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:35:40.514158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:35:40.514158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:35:40.514158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fb9a660-6782-42cf-81df-8ac25aa4873d could not be found. Jun 16 00:35:40.514158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:35:40.514158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:35:40.514158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:35:40.514158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:35:40.514158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:35:40.514158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:35:40.514158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:35:40.514158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:35:40.514158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:35:40.515948 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:35:40.515948 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:35:40.515948 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:35:40.515948 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:35:40.515948 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:35:40.515948 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:35:40.515948 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:35:40.515948 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fb9a660-6782-42cf-81df-8ac25aa4873d could not be found. Jun 16 00:35:40.515948 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:35:40.515948 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:35:40.515948 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:35:40.515948 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:35:40.515948 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:35:40.515948 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:35:40.515948 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:35:40.515948 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:35:40.515948 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fb9a660-6782-42cf-81df-8ac25aa4873d could not be found. Jun 16 00:35:40.515948 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:35:40.517364 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-34358c13-c9e1-4506-bdb8-a33b19045d0c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Returning 404 to user: Instance 9fb9a660-6782-42cf-81df-8ac25aa4873d could not be found. {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:35:40.517364 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-34358c13-c9e1-4506-bdb8-a33b19045d0c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 404 len: 111 microversion: 2.1 time: 0.030251 Jun 16 00:35:40.517364 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 417/847] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:40 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:35:40.520281 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-99c55d76-e2c2-4785-baeb-eb8cafd3f21e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '.version_select at 0x7fe7049d3700>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:40.537417 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-99c55d76-e2c2-4785-baeb-eb8cafd3f21e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2081817421" status: 202 len: 0 microversion: 2.1 time: 0.020857 Jun 16 00:35:40.537947 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 431/848] 10.222.0.23 () {58 vars in 1220 bytes} [Thu Jun 16 00:35:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2081817421 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:35:40.736351 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-a023a8fb-e43c-4850-bfb3-bd4923681d4e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:40.736921 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-a023a8fb-e43c-4850-bfb3-bd4923681d4e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 00ed7f8e-6608-40b3-81a1-31e9aa723fcf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:40.743477 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a023a8fb-e43c-4850-bfb3-bd4923681d4e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:40.743940 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a023a8fb-e43c-4850-bfb3-bd4923681d4e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:40.744699 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a023a8fb-e43c-4850-bfb3-bd4923681d4e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:40.745179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a023a8fb-e43c-4850-bfb3-bd4923681d4e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:40.974306 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a023a8fb-e43c-4850-bfb3-bd4923681d4e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:40.981851 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-a023a8fb-e43c-4850-bfb3-bd4923681d4e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf" status: 200 len: 1319 microversion: 2.1 time: 0.250185 Jun 16 00:35:40.983013 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 418/849] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:40 2022] GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:41.703763 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-2d363623-a546-40c3-8619-db2991e3b7e1 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Action: 'create', calling method: .version_select at 0x7fe70495f3a0>, body: {"keypair": {"name": "tempest-keypair-632416177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJthTCJ9NxbKY4+x+2Dob5ni04W0nWQg3CzR8pZ6PxhJp3yWH7cCS7QeOP9L/kIQcprSq9ZkCAe808aF4Y6LuppF28v7cWbN7FWglBdtstm0CY0Mhw9FHQNk8pdYuqSZdw=="}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:41.720250 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-2d363623-a546-40c3-8619-db2991e3b7e1 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Getting quotas for project d2cc2e1e741d4eeb849e07d9f2c371be. Resources: {'key_pairs'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:35:41.724726 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-2d363623-a546-40c3-8619-db2991e3b7e1 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Getting quotas for user d5985474b0774d8ea0e62718de767310 and project d2cc2e1e741d4eeb849e07d9f2c371be. Resources: {'key_pairs'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:35:41.756000 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-2d363623-a546-40c3-8619-db2991e3b7e1 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056727 Jun 16 00:35:41.763189 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 432/850] 10.222.0.23 () {60 vars in 1158 bytes} [Thu Jun 16 00:35:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:42.001682 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-14631a86-f81e-4e33-bf1e-c0636b1b222c tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:42.002349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-14631a86-f81e-4e33-bf1e-c0636b1b222c tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 00ed7f8e-6608-40b3-81a1-31e9aa723fcf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:42.010062 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-14631a86-f81e-4e33-bf1e-c0636b1b222c tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:42.010514 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-14631a86-f81e-4e33-bf1e-c0636b1b222c tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:42.011270 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-14631a86-f81e-4e33-bf1e-c0636b1b222c tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:42.011693 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-14631a86-f81e-4e33-bf1e-c0636b1b222c tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:42.164132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-14631a86-f81e-4e33-bf1e-c0636b1b222c tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:42.172481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-14631a86-f81e-4e33-bf1e-c0636b1b222c tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf" status: 200 len: 1319 microversion: 2.1 time: 0.176606 Jun 16 00:35:42.173324 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 419/851] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:41 2022] GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:43.094881 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-01fc9d70-6909-4d8c-a358-66e2450bbc16 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1329411139", "imageRef": "d9a6de24-7a5e-4f8b-b078-809c87b15d56", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4c2828a-d371-4bf1-a496-04b5f8350696"}], "security_groups": [{"name": "tempest-securitygroup--2063266536"}], "key_name": "tempest-keypair-632416177", "user_data": "}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:43.190733 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-0956b33a-1dbb-495b-9975-9abb74b39924 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:43.191523 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-0956b33a-1dbb-495b-9975-9abb74b39924 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 00ed7f8e-6608-40b3-81a1-31e9aa723fcf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:43.197696 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.network.neutron [None req-01fc9d70-6909-4d8c-a358-66e2450bbc16 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] validate_networks() for [('f4c2828a-d371-4bf1-a496-04b5f8350696', None, None, None, None, None)] {{(pid=124231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:35:43.198265 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0956b33a-1dbb-495b-9975-9abb74b39924 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:43.198709 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0956b33a-1dbb-495b-9975-9abb74b39924 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:43.199660 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0956b33a-1dbb-495b-9975-9abb74b39924 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:43.200246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0956b33a-1dbb-495b-9975-9abb74b39924 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:43.335394 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-0956b33a-1dbb-495b-9975-9abb74b39924 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:43.343125 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-0956b33a-1dbb-495b-9975-9abb74b39924 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf" status: 200 len: 1319 microversion: 2.1 time: 0.156707 Jun 16 00:35:43.343778 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 420/852] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:43 2022] GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:43.572888 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-01fc9d70-6909-4d8c-a358-66e2450bbc16 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Flavor limits 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:35:43.573321 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-01fc9d70-6909-4d8c-a358-66e2450bbc16 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Image limits 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:35:43.573791 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-01fc9d70-6909-4d8c-a358-66e2450bbc16 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Flavor pref 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:35:43.574197 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-01fc9d70-6909-4d8c-a358-66e2450bbc16 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Image pref 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:35:43.574606 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-01fc9d70-6909-4d8c-a358-66e2450bbc16 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:35:43.583896 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-01fc9d70-6909-4d8c-a358-66e2450bbc16 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:43.584340 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-01fc9d70-6909-4d8c-a358-66e2450bbc16 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:43.585160 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-01fc9d70-6909-4d8c-a358-66e2450bbc16 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:43.585591 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-01fc9d70-6909-4d8c-a358-66e2450bbc16 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:43.602704 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-01fc9d70-6909-4d8c-a358-66e2450bbc16 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Getting quotas for project d2cc2e1e741d4eeb849e07d9f2c371be. Resources: {'ram', 'cores', 'instances'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:35:43.606601 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-01fc9d70-6909-4d8c-a358-66e2450bbc16 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Getting quotas for user d5985474b0774d8ea0e62718de767310 and project d2cc2e1e741d4eeb849e07d9f2c371be. Resources: {'ram', 'cores', 'instances'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:35:43.618274 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-01fc9d70-6909-4d8c-a358-66e2450bbc16 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Going to run 1 instances... {{(pid=124231) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:35:43.620507 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-01fc9d70-6909-4d8c-a358-66e2450bbc16 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d9a6de24-7a5e-4f8b-b078-809c87b15d56',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:35:43.667154 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-01fc9d70-6909-4d8c-a358-66e2450bbc16 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.577889 Jun 16 00:35:43.667793 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 433/853] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Jun 16 00:35:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:35:43.678773 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-e46d95bf-4d91-4460-867b-92f4284130c3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:43.679612 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-e46d95bf-4d91-4460-867b-92f4284130c3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:43.734328 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-e46d95bf-4d91-4460-867b-92f4284130c3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:43.741268 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-e46d95bf-4d91-4460-867b-92f4284130c3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939" status: 200 len: 1237 microversion: 2.1 time: 0.066362 Jun 16 00:35:43.741831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 421/854] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:43 2022] GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:44.175631 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-d83b6ee2-94c3-4521-87db-fa9787a43efb req-ef6f3364-d408-45f4-81f5-42417820db9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ed7f8e-6608-40b3-81a1-31e9aa723fcf", "name": "network-vif-plugged", "status": "completed", "tag": "11a7ff88-7ccf-4a7c-a210-379711f1e7bb"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:44.191303 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-d83b6ee2-94c3-4521-87db-fa9787a43efb req-ef6f3364-d408-45f4-81f5-42417820db9b service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:44.191303 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-d83b6ee2-94c3-4521-87db-fa9787a43efb req-ef6f3364-d408-45f4-81f5-42417820db9b service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:44.203488 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-d83b6ee2-94c3-4521-87db-fa9787a43efb req-ef6f3364-d408-45f4-81f5-42417820db9b service nova] Creating event network-vif-plugged:11a7ff88-7ccf-4a7c-a210-379711f1e7bb for instance 00ed7f8e-6608-40b3-81a1-31e9aa723fcf on hv-cinder-84599 Jun 16 00:35:44.208452 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-d83b6ee2-94c3-4521-87db-fa9787a43efb req-ef6f3364-d408-45f4-81f5-42417820db9b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036867 Jun 16 00:35:44.209284 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 434/855] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:44.359939 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8d716422-2e41-4913-9c4b-6331fe49e815 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:44.360572 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-8d716422-2e41-4913-9c4b-6331fe49e815 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 00ed7f8e-6608-40b3-81a1-31e9aa723fcf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:44.368245 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8d716422-2e41-4913-9c4b-6331fe49e815 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:44.368683 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8d716422-2e41-4913-9c4b-6331fe49e815 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:44.369469 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8d716422-2e41-4913-9c4b-6331fe49e815 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:44.369900 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8d716422-2e41-4913-9c4b-6331fe49e815 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:44.519813 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-8d716422-2e41-4913-9c4b-6331fe49e815 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:44.529397 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-8d716422-2e41-4913-9c4b-6331fe49e815 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf" status: 200 len: 1319 microversion: 2.1 time: 0.173188 Jun 16 00:35:44.530274 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 422/856] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:44 2022] GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:44.760292 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-59d51e04-2cef-463e-8b5a-d58b0a197f5e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:44.761699 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-59d51e04-2cef-463e-8b5a-d58b0a197f5e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:44.772119 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59d51e04-2cef-463e-8b5a-d58b0a197f5e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:44.772568 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59d51e04-2cef-463e-8b5a-d58b0a197f5e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:44.773351 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59d51e04-2cef-463e-8b5a-d58b0a197f5e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:44.773776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-59d51e04-2cef-463e-8b5a-d58b0a197f5e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:44.843035 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-59d51e04-2cef-463e-8b5a-d58b0a197f5e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:44.851060 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-59d51e04-2cef-463e-8b5a-d58b0a197f5e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939" status: 200 len: 1307 microversion: 2.1 time: 0.094919 Jun 16 00:35:44.851625 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 435/857] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:44 2022] GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939 => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:45.547815 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-3c6f5823-5a51-4da0-8871-4ead2dc71491 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:45.549163 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-3c6f5823-5a51-4da0-8871-4ead2dc71491 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 00ed7f8e-6608-40b3-81a1-31e9aa723fcf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:45.553018 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:45.557236 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3c6f5823-5a51-4da0-8871-4ead2dc71491 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:45.557894 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3c6f5823-5a51-4da0-8871-4ead2dc71491 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:45.558732 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3c6f5823-5a51-4da0-8871-4ead2dc71491 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:45.559194 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3c6f5823-5a51-4da0-8871-4ead2dc71491 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:45.703492 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-3c6f5823-5a51-4da0-8871-4ead2dc71491 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:45.719230 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-3c6f5823-5a51-4da0-8871-4ead2dc71491 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf" status: 200 len: 1319 microversion: 2.1 time: 0.176886 Jun 16 00:35:45.720200 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 423/858] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:45 2022] GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:45.869263 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d5c3e773-95f1-4388-aa0d-3090285f4140 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:45.869946 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-d5c3e773-95f1-4388-aa0d-3090285f4140 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:45.872531 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=10,nova_api:DELETE=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:45.878209 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d5c3e773-95f1-4388-aa0d-3090285f4140 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:45.878767 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d5c3e773-95f1-4388-aa0d-3090285f4140 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:45.879587 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d5c3e773-95f1-4388-aa0d-3090285f4140 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:45.880144 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d5c3e773-95f1-4388-aa0d-3090285f4140 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:45.885633 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=71 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:46.104638 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d5c3e773-95f1-4388-aa0d-3090285f4140 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:46.112313 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-d5c3e773-95f1-4388-aa0d-3090285f4140 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939" status: 200 len: 1363 microversion: 2.1 time: 0.246798 Jun 16 00:35:46.112899 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 436/859] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:45 2022] GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:46.249083 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-f5b34fc4-08be-4da6-9885-4e7f91674840 req-5bf62ae2-9ebb-486b-a4bf-91a2d7f8b920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb6aeebb-bf67-4347-bd45-ea06175e8939", "tag": "fc37c1ff-52e8-48de-b41a-ec5a181200f5"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:46.258489 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-f5b34fc4-08be-4da6-9885-4e7f91674840 req-5bf62ae2-9ebb-486b-a4bf-91a2d7f8b920 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:46.259102 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-f5b34fc4-08be-4da6-9885-4e7f91674840 req-5bf62ae2-9ebb-486b-a4bf-91a2d7f8b920 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:46.285265 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-f5b34fc4-08be-4da6-9885-4e7f91674840 req-5bf62ae2-9ebb-486b-a4bf-91a2d7f8b920 service nova] Creating event network-changed:fc37c1ff-52e8-48de-b41a-ec5a181200f5 for instance eb6aeebb-bf67-4347-bd45-ea06175e8939 on hv-cinder-84599 Jun 16 00:35:46.290777 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-f5b34fc4-08be-4da6-9885-4e7f91674840 req-5bf62ae2-9ebb-486b-a4bf-91a2d7f8b920 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047367 Jun 16 00:35:46.291967 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 424/860] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:46.737895 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-994acd07-cb02-4fe3-bc8c-bd89f91ea1c7 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:46.738501 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-994acd07-cb02-4fe3-bc8c-bd89f91ea1c7 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 00ed7f8e-6608-40b3-81a1-31e9aa723fcf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:46.744808 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-994acd07-cb02-4fe3-bc8c-bd89f91ea1c7 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:46.745283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-994acd07-cb02-4fe3-bc8c-bd89f91ea1c7 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:46.746031 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-994acd07-cb02-4fe3-bc8c-bd89f91ea1c7 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:46.746480 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-994acd07-cb02-4fe3-bc8c-bd89f91ea1c7 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:46.874931 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-994acd07-cb02-4fe3-bc8c-bd89f91ea1c7 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:46.882677 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-994acd07-cb02-4fe3-bc8c-bd89f91ea1c7 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf" status: 200 len: 1508 microversion: 2.1 time: 0.148664 Jun 16 00:35:46.883245 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 437/861] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:46 2022] GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:47.130346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c09df9d7-528f-463d-81aa-e95d7c20c988 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:47.131048 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c09df9d7-528f-463d-81aa-e95d7c20c988 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:47.137178 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c09df9d7-528f-463d-81aa-e95d7c20c988 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:47.137627 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c09df9d7-528f-463d-81aa-e95d7c20c988 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:47.139111 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c09df9d7-528f-463d-81aa-e95d7c20c988 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:47.139887 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c09df9d7-528f-463d-81aa-e95d7c20c988 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:47.291554 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c09df9d7-528f-463d-81aa-e95d7c20c988 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:47.302367 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c09df9d7-528f-463d-81aa-e95d7c20c988 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939" status: 200 len: 1363 microversion: 2.1 time: 0.176656 Jun 16 00:35:47.302922 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 425/862] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:47 2022] GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:48.319408 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-a6605e1c-6804-4297-a08e-5fb9bd436a5d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:48.320019 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-a6605e1c-6804-4297-a08e-5fb9bd436a5d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:48.327284 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a6605e1c-6804-4297-a08e-5fb9bd436a5d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:48.327731 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a6605e1c-6804-4297-a08e-5fb9bd436a5d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:48.328497 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a6605e1c-6804-4297-a08e-5fb9bd436a5d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:48.328980 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-a6605e1c-6804-4297-a08e-5fb9bd436a5d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:48.472614 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-a6605e1c-6804-4297-a08e-5fb9bd436a5d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:48.480361 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-a6605e1c-6804-4297-a08e-5fb9bd436a5d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939" status: 200 len: 1363 microversion: 2.1 time: 0.164774 Jun 16 00:35:48.481044 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 438/863] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:48 2022] GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:49.497392 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-877aa0ae-9b51-436a-bfb9-02253b6a774d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:49.498013 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-877aa0ae-9b51-436a-bfb9-02253b6a774d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:49.504592 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-877aa0ae-9b51-436a-bfb9-02253b6a774d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:49.505117 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-877aa0ae-9b51-436a-bfb9-02253b6a774d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:49.505914 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-877aa0ae-9b51-436a-bfb9-02253b6a774d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:49.506354 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-877aa0ae-9b51-436a-bfb9-02253b6a774d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:49.642423 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-877aa0ae-9b51-436a-bfb9-02253b6a774d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:49.649935 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-877aa0ae-9b51-436a-bfb9-02253b6a774d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939" status: 200 len: 1363 microversion: 2.1 time: 0.156364 Jun 16 00:35:49.650481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 426/864] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:49 2022] GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:50.179377 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-8a73cc9f-9a5e-4043-967f-f4c6ec9c444c req-d23cbab8-dc89-4fa0-91d5-7192c82b426e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6aeebb-bf67-4347-bd45-ea06175e8939", "name": "network-vif-plugged", "status": "completed", "tag": "fc37c1ff-52e8-48de-b41a-ec5a181200f5"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:50.189481 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-8a73cc9f-9a5e-4043-967f-f4c6ec9c444c req-d23cbab8-dc89-4fa0-91d5-7192c82b426e service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:50.190270 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-8a73cc9f-9a5e-4043-967f-f4c6ec9c444c req-d23cbab8-dc89-4fa0-91d5-7192c82b426e service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:50.202014 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-8a73cc9f-9a5e-4043-967f-f4c6ec9c444c req-d23cbab8-dc89-4fa0-91d5-7192c82b426e service nova] Creating event network-vif-plugged:fc37c1ff-52e8-48de-b41a-ec5a181200f5 for instance eb6aeebb-bf67-4347-bd45-ea06175e8939 on hv-cinder-84599 Jun 16 00:35:50.206674 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-8a73cc9f-9a5e-4043-967f-f4c6ec9c444c req-d23cbab8-dc89-4fa0-91d5-7192c82b426e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030968 Jun 16 00:35:50.207282 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 439/865] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:50.667050 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-272d842d-c96a-449d-99e7-d6421cffcafb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:50.667587 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-272d842d-c96a-449d-99e7-d6421cffcafb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:50.674654 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-272d842d-c96a-449d-99e7-d6421cffcafb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:50.675094 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-272d842d-c96a-449d-99e7-d6421cffcafb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:50.675842 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-272d842d-c96a-449d-99e7-d6421cffcafb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:50.676332 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-272d842d-c96a-449d-99e7-d6421cffcafb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:50.820428 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-272d842d-c96a-449d-99e7-d6421cffcafb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:50.827917 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-272d842d-c96a-449d-99e7-d6421cffcafb tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939" status: 200 len: 1363 microversion: 2.1 time: 0.164855 Jun 16 00:35:50.828468 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 427/866] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:50 2022] GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:51.847079 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-55dd3950-2bec-4c13-ba1d-3a70c85ac2fd tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:51.847780 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-55dd3950-2bec-4c13-ba1d-3a70c85ac2fd tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:51.853992 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-55dd3950-2bec-4c13-ba1d-3a70c85ac2fd tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:51.854433 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-55dd3950-2bec-4c13-ba1d-3a70c85ac2fd tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:51.855183 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-55dd3950-2bec-4c13-ba1d-3a70c85ac2fd tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:51.855622 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-55dd3950-2bec-4c13-ba1d-3a70c85ac2fd tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:52.001916 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-55dd3950-2bec-4c13-ba1d-3a70c85ac2fd tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:52.009375 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-55dd3950-2bec-4c13-ba1d-3a70c85ac2fd tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939" status: 200 len: 1548 microversion: 2.1 time: 0.168262 Jun 16 00:35:52.009934 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 440/867] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:51 2022] GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:52.026126 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-455ab418-0266-4e6f-91ec-5da9a5f116ad tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:52.026628 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-455ab418-0266-4e6f-91ec-5da9a5f116ad tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:52.033158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-455ab418-0266-4e6f-91ec-5da9a5f116ad tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:52.033597 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-455ab418-0266-4e6f-91ec-5da9a5f116ad tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:52.034350 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-455ab418-0266-4e6f-91ec-5da9a5f116ad tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:52.034778 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-455ab418-0266-4e6f-91ec-5da9a5f116ad tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:52.112929 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-455ab418-0266-4e6f-91ec-5da9a5f116ad tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090470 Jun 16 00:35:52.113658 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 428/868] 10.222.0.23 () {58 vars in 1274 bytes} [Thu Jun 16 00:35:52 2022] GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:53.291152 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-c9f37a3b-c8b7-4756-927a-b216f5153754 req-7f27b596-2b04-42bc-b4d4-8f42710ad557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb6aeebb-bf67-4347-bd45-ea06175e8939", "tag": "fc37c1ff-52e8-48de-b41a-ec5a181200f5"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:53.300817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-c9f37a3b-c8b7-4756-927a-b216f5153754 req-7f27b596-2b04-42bc-b4d4-8f42710ad557 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:53.301412 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-c9f37a3b-c8b7-4756-927a-b216f5153754 req-7f27b596-2b04-42bc-b4d4-8f42710ad557 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:53.312539 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-c9f37a3b-c8b7-4756-927a-b216f5153754 req-7f27b596-2b04-42bc-b4d4-8f42710ad557 service nova] Creating event network-changed:fc37c1ff-52e8-48de-b41a-ec5a181200f5 for instance eb6aeebb-bf67-4347-bd45-ea06175e8939 on hv-cinder-84599 Jun 16 00:35:53.317347 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-c9f37a3b-c8b7-4756-927a-b216f5153754 req-7f27b596-2b04-42bc-b4d4-8f42710ad557 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029744 Jun 16 00:35:53.318028 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 441/869] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:00.958504 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=4 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:00.963408 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-48757756-788d-4b8d-8db9-1799aa33e747 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5c9a5f5-9b6c-4b58-b42a-779117caf5fa", "device": "/dev/sdb"}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:00.964978 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-48757756-788d-4b8d-8db9-1799aa33e747 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 00ed7f8e-6608-40b3-81a1-31e9aa723fcf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:00.972014 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-48757756-788d-4b8d-8db9-1799aa33e747 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:00.972455 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-48757756-788d-4b8d-8db9-1799aa33e747 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:00.973241 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-48757756-788d-4b8d-8db9-1799aa33e747 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:00.973669 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-48757756-788d-4b8d-8db9-1799aa33e747 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:01.206652 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-48757756-788d-4b8d-8db9-1799aa33e747 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "POST /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246599 Jun 16 00:36:01.207271 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 429/870] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Jun 16 00:36:00 2022] POST /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:02.608358 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=4 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:02.609150 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=16 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:02.613991 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-5965d4ed-c55f-4a0f-a982-482c48f6ffd2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:02.614578 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-5965d4ed-c55f-4a0f-a982-482c48f6ffd2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:02.621761 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5965d4ed-c55f-4a0f-a982-482c48f6ffd2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:02.622210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5965d4ed-c55f-4a0f-a982-482c48f6ffd2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:02.623690 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5965d4ed-c55f-4a0f-a982-482c48f6ffd2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:02.624126 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-5965d4ed-c55f-4a0f-a982-482c48f6ffd2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:02.648937 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-5965d4ed-c55f-4a0f-a982-482c48f6ffd2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Going to try to terminate instance {{(pid=124231) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:36:02.728237 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-5965d4ed-c55f-4a0f-a982-482c48f6ffd2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9" status: 204 len: 0 microversion: 2.1 time: 0.120680 Jun 16 00:36:02.728926 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 442/871] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:36:02 2022] DELETE /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 00:36:02.738354 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b0916e25-3967-4fbb-b68a-88cf895293db tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:02.739059 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-b0916e25-3967-4fbb-b68a-88cf895293db tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:02.745346 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b0916e25-3967-4fbb-b68a-88cf895293db tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:02.745799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b0916e25-3967-4fbb-b68a-88cf895293db tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:02.746560 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b0916e25-3967-4fbb-b68a-88cf895293db tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:02.746993 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b0916e25-3967-4fbb-b68a-88cf895293db tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:02.881209 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b0916e25-3967-4fbb-b68a-88cf895293db tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:02.889045 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-b0916e25-3967-4fbb-b68a-88cf895293db tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9" status: 200 len: 1578 microversion: 2.1 time: 0.155369 Jun 16 00:36:02.889857 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 430/872] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:02 2022] GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:03.907491 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-f0110b3c-cc73-4f08-a6c2-22f710dc0ede tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:03.908235 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-f0110b3c-cc73-4f08-a6c2-22f710dc0ede tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:03.914686 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f0110b3c-cc73-4f08-a6c2-22f710dc0ede tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:03.915126 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f0110b3c-cc73-4f08-a6c2-22f710dc0ede tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:03.915877 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f0110b3c-cc73-4f08-a6c2-22f710dc0ede tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:03.916306 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f0110b3c-cc73-4f08-a6c2-22f710dc0ede tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:04.053048 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-f0110b3c-cc73-4f08-a6c2-22f710dc0ede tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:04.060568 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-f0110b3c-cc73-4f08-a6c2-22f710dc0ede tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9" status: 200 len: 1578 microversion: 2.1 time: 0.157837 Jun 16 00:36:04.062396 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 443/873] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:03 2022] GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:05.079364 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d868bda3-0f15-49aa-b7a8-9c219040d9fa tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:05.079969 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d868bda3-0f15-49aa-b7a8-9c219040d9fa tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:05.086344 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d868bda3-0f15-49aa-b7a8-9c219040d9fa tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:05.086788 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d868bda3-0f15-49aa-b7a8-9c219040d9fa tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:05.087686 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d868bda3-0f15-49aa-b7a8-9c219040d9fa tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:05.088119 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d868bda3-0f15-49aa-b7a8-9c219040d9fa tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:05.150403 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d868bda3-0f15-49aa-b7a8-9c219040d9fa tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:05.159415 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d868bda3-0f15-49aa-b7a8-9c219040d9fa tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9" status: 200 len: 1510 microversion: 2.1 time: 0.084709 Jun 16 00:36:05.159992 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 431/874] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:05 2022] GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 => generated 1510 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:05.281861 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-9c0f6d69-4603-4603-a737-4d2a0b799a93 req-f0f57da6-bd42-466f-ac05-4adc9990458c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2bccd7b-433f-4329-9ab3-fceb9fc211d9", "name": "network-vif-deleted", "tag": "f7b617ce-d0a8-45c4-9993-9a0d5acdc60b"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:05.290678 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-9c0f6d69-4603-4603-a737-4d2a0b799a93 req-f0f57da6-bd42-466f-ac05-4adc9990458c service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:05.291193 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-9c0f6d69-4603-4603-a737-4d2a0b799a93 req-f0f57da6-bd42-466f-ac05-4adc9990458c service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:05.302590 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-9c0f6d69-4603-4603-a737-4d2a0b799a93 req-f0f57da6-bd42-466f-ac05-4adc9990458c service nova] Creating event network-vif-deleted:f7b617ce-d0a8-45c4-9993-9a0d5acdc60b for instance a2bccd7b-433f-4329-9ab3-fceb9fc211d9 on hv-cinder-84599 Jun 16 00:36:05.308149 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-9c0f6d69-4603-4603-a737-4d2a0b799a93 req-f0f57da6-bd42-466f-ac05-4adc9990458c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030832 Jun 16 00:36:05.309385 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 444/875] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:06.175831 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-596136aa-2a57-4513-a01c-d7769bf3d7d2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:06.176384 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-596136aa-2a57-4513-a01c-d7769bf3d7d2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:06.182925 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-596136aa-2a57-4513-a01c-d7769bf3d7d2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:06.183369 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-596136aa-2a57-4513-a01c-d7769bf3d7d2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:06.184127 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-596136aa-2a57-4513-a01c-d7769bf3d7d2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:06.184557 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-596136aa-2a57-4513-a01c-d7769bf3d7d2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:06.198512 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-596136aa-2a57-4513-a01c-d7769bf3d7d2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] HTTP exception thrown: Instance a2bccd7b-433f-4329-9ab3-fceb9fc211d9 could not be found. Jun 16 00:36:06.200190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-596136aa-2a57-4513-a01c-d7769bf3d7d2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Request method failure captured: Jun 16 00:36:06.200190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 HTTP/1.1 Jun 16 00:36:06.200190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:36:06.200190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:36:06.200190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:36:06.200190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:36:06.200190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:36:06.200190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:36:06.200190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:36:06.200190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:36:06.200190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnpQzdGa4d0-6coN85jiITqtaVaXt9dclwoHXU-AtrV7TnRKBhQ1Fy-tggtCmlOtZOfk-2-wRZWJR0qI9Gu_gZQrmjT2RuXABZJkE0xz9CY7ByMcZRpeworsPSy4K2FXkUHwwXk6AJCL6P76LxZ-dOz9b9-H9hvaydj500viXX4nxlA Jun 16 00:36:06.200190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:36:06.200190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:36:06.200190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:36:06.200190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:36:06.200190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:36:06.200190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:36:06.200190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: 193571b962dc4fa1aac98a6acbdc9370 Jun 16 00:36:06.200190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-TestVolumeBootPattern-1913642732 Jun 16 00:36:06.200190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:36:06.200190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:36:06.202496 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_193571b962dc4fa1aac98a6acbdc9370"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/193571b962dc4fa1aac98a6acbdc9370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/193571b962dc4fa1aac98a6acbdc9370"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/193571b962dc4fa1aac98a6acbdc9370"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:36:06.202496 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-TestVolumeBootPattern-1913642732 Jun 16 00:36:06.202496 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: 193571b962dc4fa1aac98a6acbdc9370 Jun 16 00:36:06.202496 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-TestVolumeBootPattern-1913642732 Jun 16 00:36:06.202496 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-TestVolumeBootPattern-1913642732-project Jun 16 00:36:06.202496 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:36:06.202496 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:36:06.202496 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: 728f4031df4148fe9ec9bf9ab31d25e5 Jun 16 00:36:06.202496 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-TestVolumeBootPattern-1913642732-project Jun 16 00:36:06.202496 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: > Jun 16 00:36:06.202496 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Instance a2bccd7b-433f-4329-9ab3-fceb9fc211d9 could not be found. Jun 16 00:36:06.202496 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'id': 'a2bccd7b-433f-4329-9ab3-fceb9fc211d9'} Jun 16 00:36:06.203717 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:36:06.203717 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:06.203717 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:36:06.203717 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:36:06.203717 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:36:06.203717 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:36:06.203717 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:36:06.203717 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:36:06.203717 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:36:06.203717 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:36:06.203717 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2bccd7b-433f-4329-9ab3-fceb9fc211d9 could not be found. Jun 16 00:36:06.203717 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:36:06.203717 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:06.203717 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:36:06.203717 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:06.203717 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:06.203717 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:06.203717 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:36:06.203717 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:36:06.203717 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:36:06.205022 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:36:06.205022 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:36:06.205022 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:36:06.205022 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:36:06.205022 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:36:06.205022 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:36:06.205022 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:36:06.205022 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2bccd7b-433f-4329-9ab3-fceb9fc211d9 could not be found. Jun 16 00:36:06.205022 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:36:06.205022 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:06.205022 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:36:06.205022 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:06.205022 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:06.205022 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:06.205022 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:36:06.205022 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:36:06.205022 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2bccd7b-433f-4329-9ab3-fceb9fc211d9 could not be found. Jun 16 00:36:06.205022 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:36:06.206168 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-596136aa-2a57-4513-a01c-d7769bf3d7d2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Returning 404 to user: Instance a2bccd7b-433f-4329-9ab3-fceb9fc211d9 could not be found. {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:36:06.206168 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-596136aa-2a57-4513-a01c-d7769bf3d7d2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9" status: 404 len: 111 microversion: 2.1 time: 0.029818 Jun 16 00:36:06.206168 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 432/876] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:06 2022] GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:36:06.301193 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-0a279f68-35b7-4f98-b5d9-4d46767aa230 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1833196816", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1933822337", "security_groups": [{"name": "tempest-secgroup-smoke-1587681135"}], "block_device_mapping_v2": [{"uuid": "7f2c6e7f-dc19-4157-9f28-a69b0dd7a97e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7336ae8f-8600-4e86-b586-ccb4abcd0dc1"}]}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:06.421033 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.network.neutron [None req-0a279f68-35b7-4f98-b5d9-4d46767aa230 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] validate_networks() for [('7336ae8f-8600-4e86-b586-ccb4abcd0dc1', None, None, None, None, None)] {{(pid=124231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:36:06.781106 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-0a279f68-35b7-4f98-b5d9-4d46767aa230 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Flavor limits 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:36:06.781527 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-0a279f68-35b7-4f98-b5d9-4d46767aa230 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Image limits 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:36:06.781997 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-0a279f68-35b7-4f98-b5d9-4d46767aa230 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Flavor pref 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:36:06.782432 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-0a279f68-35b7-4f98-b5d9-4d46767aa230 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Image pref 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:36:06.782839 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-0a279f68-35b7-4f98-b5d9-4d46767aa230 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:36:06.791649 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0a279f68-35b7-4f98-b5d9-4d46767aa230 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:06.792089 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0a279f68-35b7-4f98-b5d9-4d46767aa230 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:06.792909 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0a279f68-35b7-4f98-b5d9-4d46767aa230 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:06.793339 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0a279f68-35b7-4f98-b5d9-4d46767aa230 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:06.810186 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-0a279f68-35b7-4f98-b5d9-4d46767aa230 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Getting quotas for project 193571b962dc4fa1aac98a6acbdc9370. Resources: {'ram', 'cores', 'instances'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:36:06.814886 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-0a279f68-35b7-4f98-b5d9-4d46767aa230 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Getting quotas for user 728f4031df4148fe9ec9bf9ab31d25e5 and project 193571b962dc4fa1aac98a6acbdc9370. Resources: {'ram', 'cores', 'instances'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:36:06.870743 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-0a279f68-35b7-4f98-b5d9-4d46767aa230 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Going to run 1 instances... {{(pid=124231) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:36:06.872976 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-0a279f68-35b7-4f98-b5d9-4d46767aa230 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f2c6e7f-dc19-4157-9f28-a69b0dd7a97e',volume_size=None,volume_type=None)] {{(pid=124231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:36:07.002629 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-0a279f68-35b7-4f98-b5d9-4d46767aa230 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.705999 Jun 16 00:36:07.003288 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 445/877] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Jun 16 00:36:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:36:07.013302 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-18e69436-183b-4d97-8a1d-0ca84431bc71 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:07.014006 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-18e69436-183b-4d97-8a1d-0ca84431bc71 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:07.078292 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-18e69436-183b-4d97-8a1d-0ca84431bc71 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:07.085191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-18e69436-183b-4d97-8a1d-0ca84431bc71 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1095 microversion: 2.1 time: 0.075696 Jun 16 00:36:07.085778 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 433/878] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:07 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:08.102448 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-0f993d18-4be1-498a-88bc-83650c621c0b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:08.103049 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-0f993d18-4be1-498a-88bc-83650c621c0b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:08.111002 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0f993d18-4be1-498a-88bc-83650c621c0b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:08.111520 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0f993d18-4be1-498a-88bc-83650c621c0b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:08.112467 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0f993d18-4be1-498a-88bc-83650c621c0b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:08.112920 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0f993d18-4be1-498a-88bc-83650c621c0b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:08.175242 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-0f993d18-4be1-498a-88bc-83650c621c0b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:08.182528 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-0f993d18-4be1-498a-88bc-83650c621c0b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1211 microversion: 2.1 time: 0.083904 Jun 16 00:36:08.183091 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 446/879] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:08 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:09.199488 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-54a2814c-7e16-4e10-b3f9-dd39c4b1860b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:09.200099 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-54a2814c-7e16-4e10-b3f9-dd39c4b1860b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:09.210126 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-54a2814c-7e16-4e10-b3f9-dd39c4b1860b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:09.210575 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-54a2814c-7e16-4e10-b3f9-dd39c4b1860b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:09.211336 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-54a2814c-7e16-4e10-b3f9-dd39c4b1860b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:09.211774 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-54a2814c-7e16-4e10-b3f9-dd39c4b1860b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:09.272765 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-54a2814c-7e16-4e10-b3f9-dd39c4b1860b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:09.280408 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-54a2814c-7e16-4e10-b3f9-dd39c4b1860b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1211 microversion: 2.1 time: 0.084804 Jun 16 00:36:09.280985 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 434/880] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:09 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1211 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:10.297795 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-0efe0278-5b08-4748-a170-b1c5965b4219 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:10.298433 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-0efe0278-5b08-4748-a170-b1c5965b4219 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:10.304897 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0efe0278-5b08-4748-a170-b1c5965b4219 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:10.305344 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0efe0278-5b08-4748-a170-b1c5965b4219 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:10.306096 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0efe0278-5b08-4748-a170-b1c5965b4219 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:10.306524 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0efe0278-5b08-4748-a170-b1c5965b4219 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:10.369280 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-0efe0278-5b08-4748-a170-b1c5965b4219 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:10.376541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-0efe0278-5b08-4748-a170-b1c5965b4219 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1211 microversion: 2.1 time: 0.083278 Jun 16 00:36:10.377239 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 447/881] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:10 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:11.392423 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-03097288-7c33-4e6b-b8f8-ecc98e761c88 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:11.393061 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-03097288-7c33-4e6b-b8f8-ecc98e761c88 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:11.399497 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-03097288-7c33-4e6b-b8f8-ecc98e761c88 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:11.399938 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-03097288-7c33-4e6b-b8f8-ecc98e761c88 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:11.400684 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-03097288-7c33-4e6b-b8f8-ecc98e761c88 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:11.401132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-03097288-7c33-4e6b-b8f8-ecc98e761c88 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:11.405132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:11.538472 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-03097288-7c33-4e6b-b8f8-ecc98e761c88 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:11.546684 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-03097288-7c33-4e6b-b8f8-ecc98e761c88 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1267 microversion: 2.1 time: 0.158367 Jun 16 00:36:11.547334 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 435/882] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:11 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:11.889804 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-7fff32d5-34e4-49bd-b745-82a8d8c63520 req-68809d42-a491-43ce-8359-60b59cc3fbe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8", "tag": "37d0519d-bed0-4032-aef6-086b99f07e85"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:11.898522 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-7fff32d5-34e4-49bd-b745-82a8d8c63520 req-68809d42-a491-43ce-8359-60b59cc3fbe6 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:11.898959 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-7fff32d5-34e4-49bd-b745-82a8d8c63520 req-68809d42-a491-43ce-8359-60b59cc3fbe6 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:12.064545 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-7fff32d5-34e4-49bd-b745-82a8d8c63520 req-68809d42-a491-43ce-8359-60b59cc3fbe6 service nova] Creating event network-changed:37d0519d-bed0-4032-aef6-086b99f07e85 for instance 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 on hv-cinder-84599 Jun 16 00:36:12.069760 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-7fff32d5-34e4-49bd-b745-82a8d8c63520 req-68809d42-a491-43ce-8359-60b59cc3fbe6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185510 Jun 16 00:36:12.070354 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 448/883] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:12.565055 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8a190781-569e-41b6-a496-d47ce3480aa2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:12.565649 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-8a190781-569e-41b6-a496-d47ce3480aa2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:12.571830 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8a190781-569e-41b6-a496-d47ce3480aa2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:12.572278 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8a190781-569e-41b6-a496-d47ce3480aa2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:12.573075 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8a190781-569e-41b6-a496-d47ce3480aa2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:12.573508 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8a190781-569e-41b6-a496-d47ce3480aa2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:12.710111 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-8a190781-569e-41b6-a496-d47ce3480aa2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:12.718901 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-8a190781-569e-41b6-a496-d47ce3480aa2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1267 microversion: 2.1 time: 0.159066 Jun 16 00:36:12.719877 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 436/884] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:12 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:13.737333 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-7386e8a6-9980-454a-b7f8-f7c0d1ec0c9c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:13.738025 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-7386e8a6-9980-454a-b7f8-f7c0d1ec0c9c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:13.744232 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7386e8a6-9980-454a-b7f8-f7c0d1ec0c9c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:13.744677 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7386e8a6-9980-454a-b7f8-f7c0d1ec0c9c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:13.745454 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7386e8a6-9980-454a-b7f8-f7c0d1ec0c9c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:13.745886 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7386e8a6-9980-454a-b7f8-f7c0d1ec0c9c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:13.877840 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-7386e8a6-9980-454a-b7f8-f7c0d1ec0c9c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:13.885204 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-7386e8a6-9980-454a-b7f8-f7c0d1ec0c9c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1267 microversion: 2.1 time: 0.153265 Jun 16 00:36:13.885756 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 449/885] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:13 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:14.902520 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-bcf205c5-9564-4120-841b-b2df8162b10e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:14.903119 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-bcf205c5-9564-4120-841b-b2df8162b10e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:14.910239 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bcf205c5-9564-4120-841b-b2df8162b10e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:14.910714 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bcf205c5-9564-4120-841b-b2df8162b10e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:14.911490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bcf205c5-9564-4120-841b-b2df8162b10e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:14.911917 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bcf205c5-9564-4120-841b-b2df8162b10e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:15.047681 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-bcf205c5-9564-4120-841b-b2df8162b10e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:15.055756 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-bcf205c5-9564-4120-841b-b2df8162b10e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1267 microversion: 2.1 time: 0.156932 Jun 16 00:36:15.056337 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 437/886] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:14 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:16.072809 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-230dfe22-8941-4884-b4d0-f0d41374b8bb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:16.073429 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-230dfe22-8941-4884-b4d0-f0d41374b8bb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:16.075811 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:16.081169 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-230dfe22-8941-4884-b4d0-f0d41374b8bb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:16.081614 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-230dfe22-8941-4884-b4d0-f0d41374b8bb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:16.082384 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-230dfe22-8941-4884-b4d0-f0d41374b8bb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:16.082819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-230dfe22-8941-4884-b4d0-f0d41374b8bb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:16.087525 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:16.219460 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-230dfe22-8941-4884-b4d0-f0d41374b8bb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:16.226915 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-230dfe22-8941-4884-b4d0-f0d41374b8bb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1267 microversion: 2.1 time: 0.157988 Jun 16 00:36:16.227469 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 450/887] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:16 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:17.244573 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8cf533ac-5f54-479e-ac1d-db3173acc9c1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:17.245199 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-8cf533ac-5f54-479e-ac1d-db3173acc9c1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:17.247489 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=2 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:17.248126 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=32 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:17.254766 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8cf533ac-5f54-479e-ac1d-db3173acc9c1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:17.255204 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8cf533ac-5f54-479e-ac1d-db3173acc9c1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:17.255958 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8cf533ac-5f54-479e-ac1d-db3173acc9c1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:17.256385 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8cf533ac-5f54-479e-ac1d-db3173acc9c1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:17.392687 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-8cf533ac-5f54-479e-ac1d-db3173acc9c1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:17.400374 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-8cf533ac-5f54-479e-ac1d-db3173acc9c1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1267 microversion: 2.1 time: 0.159641 Jun 16 00:36:17.400953 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 438/888] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:17 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:18.417227 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-117d4d93-5515-40da-b2df-430c76bf00a2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:18.417833 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-117d4d93-5515-40da-b2df-430c76bf00a2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:18.419710 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=2 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:18.421728 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=6 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:18.428596 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-117d4d93-5515-40da-b2df-430c76bf00a2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:18.429072 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-117d4d93-5515-40da-b2df-430c76bf00a2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:18.429835 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-117d4d93-5515-40da-b2df-430c76bf00a2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:18.430266 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-117d4d93-5515-40da-b2df-430c76bf00a2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:18.560344 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-117d4d93-5515-40da-b2df-430c76bf00a2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:18.567879 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-117d4d93-5515-40da-b2df-430c76bf00a2 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1267 microversion: 2.1 time: 0.154595 Jun 16 00:36:18.568432 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 451/889] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:18 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:19.585370 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-03b15c5e-572e-4b2a-8173-fb7d534e1f65 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:19.585977 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-03b15c5e-572e-4b2a-8173-fb7d534e1f65 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:19.592620 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-03b15c5e-572e-4b2a-8173-fb7d534e1f65 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:19.593165 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-03b15c5e-572e-4b2a-8173-fb7d534e1f65 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:19.593994 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-03b15c5e-572e-4b2a-8173-fb7d534e1f65 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:19.594421 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-03b15c5e-572e-4b2a-8173-fb7d534e1f65 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:19.729814 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-03b15c5e-572e-4b2a-8173-fb7d534e1f65 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:19.738228 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-03b15c5e-572e-4b2a-8173-fb7d534e1f65 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1267 microversion: 2.1 time: 0.156641 Jun 16 00:36:19.738783 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 439/890] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:19 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:20.755562 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-568eb53d-e71e-42f2-9e85-9fecd463aa68 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:20.756219 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-568eb53d-e71e-42f2-9e85-9fecd463aa68 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:20.765330 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-568eb53d-e71e-42f2-9e85-9fecd463aa68 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:20.765780 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-568eb53d-e71e-42f2-9e85-9fecd463aa68 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:20.766540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-568eb53d-e71e-42f2-9e85-9fecd463aa68 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:20.767057 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-568eb53d-e71e-42f2-9e85-9fecd463aa68 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:20.905917 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-568eb53d-e71e-42f2-9e85-9fecd463aa68 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:20.913278 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-568eb53d-e71e-42f2-9e85-9fecd463aa68 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1267 microversion: 2.1 time: 0.161676 Jun 16 00:36:20.913840 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 452/891] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:20 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:21.931088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-35fe931c-aa72-47ae-8b3f-cf3dc780de2c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:21.931780 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-35fe931c-aa72-47ae-8b3f-cf3dc780de2c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:21.939968 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-35fe931c-aa72-47ae-8b3f-cf3dc780de2c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:21.940405 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-35fe931c-aa72-47ae-8b3f-cf3dc780de2c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:21.941227 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-35fe931c-aa72-47ae-8b3f-cf3dc780de2c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:21.941678 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-35fe931c-aa72-47ae-8b3f-cf3dc780de2c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:22.075281 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-35fe931c-aa72-47ae-8b3f-cf3dc780de2c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:22.083245 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-35fe931c-aa72-47ae-8b3f-cf3dc780de2c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1267 microversion: 2.1 time: 0.156340 Jun 16 00:36:22.083808 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 440/892] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:21 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:22.789443 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-eff8b903-3c5d-42bc-b1e4-698bc050e047 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:22.789956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-eff8b903-3c5d-42bc-b1e4-698bc050e047 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 00ed7f8e-6608-40b3-81a1-31e9aa723fcf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:22.797761 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-eff8b903-3c5d-42bc-b1e4-698bc050e047 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:22.798209 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-eff8b903-3c5d-42bc-b1e4-698bc050e047 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:22.798966 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-eff8b903-3c5d-42bc-b1e4-698bc050e047 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:22.799397 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-eff8b903-3c5d-42bc-b1e4-698bc050e047 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:22.880552 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.objects.instance [None req-eff8b903-3c5d-42bc-b1e4-698bc050e047 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lazy-loading 'services' on Instance uuid 00ed7f8e-6608-40b3-81a1-31e9aa723fcf {{(pid=124231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:36:22.950768 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-eff8b903-3c5d-42bc-b1e4-698bc050e047 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "DELETE /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf/os-volume_attachments/f5c9a5f5-9b6c-4b58-b42a-779117caf5fa" status: 202 len: 0 microversion: 2.1 time: 0.165056 Jun 16 00:36:22.952010 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 453/893] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Jun 16 00:36:22 2022] DELETE /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf/os-volume_attachments/f5c9a5f5-9b6c-4b58-b42a-779117caf5fa => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:36:23.101365 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-774689aa-14f0-4474-801f-4c8e1e8ccbaf tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:23.101970 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-774689aa-14f0-4474-801f-4c8e1e8ccbaf tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:23.109069 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-774689aa-14f0-4474-801f-4c8e1e8ccbaf tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:23.109512 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-774689aa-14f0-4474-801f-4c8e1e8ccbaf tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:23.110273 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-774689aa-14f0-4474-801f-4c8e1e8ccbaf tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:23.110697 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-774689aa-14f0-4474-801f-4c8e1e8ccbaf tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:23.243016 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-774689aa-14f0-4474-801f-4c8e1e8ccbaf tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:23.250959 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-774689aa-14f0-4474-801f-4c8e1e8ccbaf tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1267 microversion: 2.1 time: 0.153530 Jun 16 00:36:23.251510 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 441/894] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:23 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:24.269243 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-3c4392fe-86c3-43a4-8896-b45684473bb6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:24.270068 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-3c4392fe-86c3-43a4-8896-b45684473bb6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:24.276620 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3c4392fe-86c3-43a4-8896-b45684473bb6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:24.277095 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3c4392fe-86c3-43a4-8896-b45684473bb6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:24.278041 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3c4392fe-86c3-43a4-8896-b45684473bb6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:24.278641 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3c4392fe-86c3-43a4-8896-b45684473bb6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:24.413697 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-3c4392fe-86c3-43a4-8896-b45684473bb6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:24.421775 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-3c4392fe-86c3-43a4-8896-b45684473bb6 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1267 microversion: 2.1 time: 0.158509 Jun 16 00:36:24.422421 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 454/895] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:24 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:25.183610 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-0f8744e1-e53a-47b1-bcbb-7f562a84bbb4 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:25.184179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-0f8744e1-e53a-47b1-bcbb-7f562a84bbb4 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 00ed7f8e-6608-40b3-81a1-31e9aa723fcf] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:25.190791 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0f8744e1-e53a-47b1-bcbb-7f562a84bbb4 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:25.191246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0f8744e1-e53a-47b1-bcbb-7f562a84bbb4 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:25.192046 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0f8744e1-e53a-47b1-bcbb-7f562a84bbb4 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:25.192485 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-0f8744e1-e53a-47b1-bcbb-7f562a84bbb4 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:25.217848 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-0f8744e1-e53a-47b1-bcbb-7f562a84bbb4 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 00ed7f8e-6608-40b3-81a1-31e9aa723fcf] Going to try to terminate instance {{(pid=124230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:36:25.297376 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-0f8744e1-e53a-47b1-bcbb-7f562a84bbb4 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "DELETE /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf" status: 204 len: 0 microversion: 2.1 time: 0.117345 Jun 16 00:36:25.298164 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 442/896] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:36:25 2022] DELETE /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:36:25.307596 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-c50f607e-d4ae-4d68-86fb-adb5deca5a47 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:25.308217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-c50f607e-d4ae-4d68-86fb-adb5deca5a47 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 00ed7f8e-6608-40b3-81a1-31e9aa723fcf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:25.318806 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c50f607e-d4ae-4d68-86fb-adb5deca5a47 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:25.319250 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c50f607e-d4ae-4d68-86fb-adb5deca5a47 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:25.320033 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c50f607e-d4ae-4d68-86fb-adb5deca5a47 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:25.320464 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c50f607e-d4ae-4d68-86fb-adb5deca5a47 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:25.438497 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-be24998a-8cc3-4393-8657-423b3d433d65 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:25.439282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-be24998a-8cc3-4393-8657-423b3d433d65 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:25.445429 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-be24998a-8cc3-4393-8657-423b3d433d65 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:25.445947 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-be24998a-8cc3-4393-8657-423b3d433d65 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:25.446769 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-be24998a-8cc3-4393-8657-423b3d433d65 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:25.447261 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-be24998a-8cc3-4393-8657-423b3d433d65 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:25.452854 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-c50f607e-d4ae-4d68-86fb-adb5deca5a47 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:25.460408 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-c50f607e-d4ae-4d68-86fb-adb5deca5a47 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf" status: 200 len: 1514 microversion: 2.1 time: 0.157100 Jun 16 00:36:25.461000 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 455/897] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:25 2022] GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:25.582188 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-be24998a-8cc3-4393-8657-423b3d433d65 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:25.589819 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-be24998a-8cc3-4393-8657-423b3d433d65 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1267 microversion: 2.1 time: 0.155668 Jun 16 00:36:25.590383 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 443/898] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:25 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:26.478135 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-72eec3c8-c9b8-4294-abef-5e405573428b tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:26.478744 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-72eec3c8-c9b8-4294-abef-5e405573428b tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 00ed7f8e-6608-40b3-81a1-31e9aa723fcf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:26.485576 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-72eec3c8-c9b8-4294-abef-5e405573428b tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:26.486018 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-72eec3c8-c9b8-4294-abef-5e405573428b tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:26.486776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-72eec3c8-c9b8-4294-abef-5e405573428b tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:26.487204 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-72eec3c8-c9b8-4294-abef-5e405573428b tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:26.606561 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-3e5cfccd-4491-430b-b4b0-4e34ebaaabed tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:26.607245 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-3e5cfccd-4491-430b-b4b0-4e34ebaaabed tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:26.613719 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3e5cfccd-4491-430b-b4b0-4e34ebaaabed tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:26.614164 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3e5cfccd-4491-430b-b4b0-4e34ebaaabed tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:26.614915 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3e5cfccd-4491-430b-b4b0-4e34ebaaabed tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:26.615345 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3e5cfccd-4491-430b-b4b0-4e34ebaaabed tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:26.619622 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-72eec3c8-c9b8-4294-abef-5e405573428b tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:26.627527 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-72eec3c8-c9b8-4294-abef-5e405573428b tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf" status: 200 len: 1514 microversion: 2.1 time: 0.153292 Jun 16 00:36:26.628087 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 456/899] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:26 2022] GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:26.751683 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-3e5cfccd-4491-430b-b4b0-4e34ebaaabed tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:26.759079 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-3e5cfccd-4491-430b-b4b0-4e34ebaaabed tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1267 microversion: 2.1 time: 0.156417 Jun 16 00:36:26.759629 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 444/900] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:26 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:27.364748 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-fde2c13c-744f-4628-8187-bc62b1c7be31 req-be20a125-98ea-48c3-beac-93ac58b0eca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8", "name": "network-vif-plugged", "status": "completed", "tag": "37d0519d-bed0-4032-aef6-086b99f07e85"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:27.373289 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-fde2c13c-744f-4628-8187-bc62b1c7be31 req-be20a125-98ea-48c3-beac-93ac58b0eca2 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:27.373773 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-fde2c13c-744f-4628-8187-bc62b1c7be31 req-be20a125-98ea-48c3-beac-93ac58b0eca2 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:27.385364 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-fde2c13c-744f-4628-8187-bc62b1c7be31 req-be20a125-98ea-48c3-beac-93ac58b0eca2 service nova] Creating event network-vif-plugged:37d0519d-bed0-4032-aef6-086b99f07e85 for instance 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 on hv-cinder-84599 Jun 16 00:36:27.390471 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-fde2c13c-744f-4628-8187-bc62b1c7be31 req-be20a125-98ea-48c3-beac-93ac58b0eca2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029665 Jun 16 00:36:27.391684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 457/901] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:36:27.496572 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-0c5fb3aa-c037-409f-be50-44a9fc374031 req-f1ea1e2d-6592-4d5d-95c5-afda2ef91d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ed7f8e-6608-40b3-81a1-31e9aa723fcf", "name": "network-vif-deleted", "tag": "11a7ff88-7ccf-4a7c-a210-379711f1e7bb"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:27.506051 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-0c5fb3aa-c037-409f-be50-44a9fc374031 req-f1ea1e2d-6592-4d5d-95c5-afda2ef91d77 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:27.506514 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-0c5fb3aa-c037-409f-be50-44a9fc374031 req-f1ea1e2d-6592-4d5d-95c5-afda2ef91d77 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:27.518751 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-0c5fb3aa-c037-409f-be50-44a9fc374031 req-f1ea1e2d-6592-4d5d-95c5-afda2ef91d77 service nova] Creating event network-vif-deleted:11a7ff88-7ccf-4a7c-a210-379711f1e7bb for instance 00ed7f8e-6608-40b3-81a1-31e9aa723fcf on hv-cinder-84599 Jun 16 00:36:27.524943 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-0c5fb3aa-c037-409f-be50-44a9fc374031 req-f1ea1e2d-6592-4d5d-95c5-afda2ef91d77 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032489 Jun 16 00:36:27.525534 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 445/902] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:27.646300 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-4a0e75a5-320b-42a5-9938-8205e4c002e6 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:27.647270 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-4a0e75a5-320b-42a5-9938-8205e4c002e6 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 00ed7f8e-6608-40b3-81a1-31e9aa723fcf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:27.655278 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4a0e75a5-320b-42a5-9938-8205e4c002e6 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:27.655833 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4a0e75a5-320b-42a5-9938-8205e4c002e6 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:27.656675 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4a0e75a5-320b-42a5-9938-8205e4c002e6 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:27.657188 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4a0e75a5-320b-42a5-9938-8205e4c002e6 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:27.690430 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4a0e75a5-320b-42a5-9938-8205e4c002e6 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:27.690873 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4a0e75a5-320b-42a5-9938-8205e4c002e6 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:27.691315 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.objects.instance [None req-4a0e75a5-320b-42a5-9938-8205e4c002e6 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lazy-loading 'fault' on Instance uuid 00ed7f8e-6608-40b3-81a1-31e9aa723fcf {{(pid=124231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:36:27.740049 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-4a0e75a5-320b-42a5-9938-8205e4c002e6 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:27.747372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-4a0e75a5-320b-42a5-9938-8205e4c002e6 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf" status: 200 len: 1309 microversion: 2.1 time: 0.106089 Jun 16 00:36:27.748180 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 458/903] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:27 2022] GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf => generated 1309 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:27.778024 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-700bffb5-540f-4368-af4d-026e1b4c87a1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:27.779451 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-700bffb5-540f-4368-af4d-026e1b4c87a1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:27.786419 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-700bffb5-540f-4368-af4d-026e1b4c87a1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:27.786861 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-700bffb5-540f-4368-af4d-026e1b4c87a1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:27.788996 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-700bffb5-540f-4368-af4d-026e1b4c87a1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:27.789429 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-700bffb5-540f-4368-af4d-026e1b4c87a1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:27.932344 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-700bffb5-540f-4368-af4d-026e1b4c87a1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:27.940306 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-700bffb5-540f-4368-af4d-026e1b4c87a1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1267 microversion: 2.1 time: 0.167098 Jun 16 00:36:27.940866 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 446/904] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:27 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:28.764813 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-3aaff0a4-41e4-47cf-a198-5eac4f15b027 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:28.765465 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-3aaff0a4-41e4-47cf-a198-5eac4f15b027 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 00ed7f8e-6608-40b3-81a1-31e9aa723fcf] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:28.772638 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3aaff0a4-41e4-47cf-a198-5eac4f15b027 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:28.773126 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3aaff0a4-41e4-47cf-a198-5eac4f15b027 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:28.773898 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3aaff0a4-41e4-47cf-a198-5eac4f15b027 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:28.774338 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3aaff0a4-41e4-47cf-a198-5eac4f15b027 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:28.787873 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-3aaff0a4-41e4-47cf-a198-5eac4f15b027 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] HTTP exception thrown: Instance 00ed7f8e-6608-40b3-81a1-31e9aa723fcf could not be found. Jun 16 00:36:28.789541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-3aaff0a4-41e4-47cf-a198-5eac4f15b027 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Request method failure captured: Jun 16 00:36:28.789541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf HTTP/1.1 Jun 16 00:36:28.789541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:36:28.789541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:36:28.789541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:36:28.789541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:36:28.789541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:36:28.789541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:36:28.789541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:36:28.789541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:36:28.789541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnrVSL7_TdS6otJPo5AgErN_O2oEoCLXAZbhC61hr-qjAuqbEz7JuxDN0SIRwy_mqQWgDViO-EDwcHyVfsmi2drA1v987xEyMWabTMphYMvejPVqv_OBlUoZn3OCzn6V1LdfBnOxWbVIBFi491Y3bP7VZfS8l2XUIevbMyIQJ-RLgG8 Jun 16 00:36:28.789541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:36:28.789541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:36:28.789541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:36:28.789541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:36:28.789541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:36:28.789541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:36:28.789541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: 8dd0505146da40efbb028199390f8c75 Jun 16 00:36:28.789541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1108582580 Jun 16 00:36:28.789541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:36:28.789541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:36:28.791147 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8dd0505146da40efbb028199390f8c75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8dd0505146da40efbb028199390f8c75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8dd0505146da40efbb028199390f8c75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8dd0505146da40efbb028199390f8c75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:36:28.791147 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-VolumesSnapshotTestJSON-1108582580 Jun 16 00:36:28.791147 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: 8dd0505146da40efbb028199390f8c75 Jun 16 00:36:28.791147 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1108582580 Jun 16 00:36:28.791147 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-VolumesSnapshotTestJSON-1108582580-project Jun 16 00:36:28.791147 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:36:28.791147 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:36:28.791147 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: f77cfd6c2be6487e9701e08340c6c792 Jun 16 00:36:28.791147 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-VolumesSnapshotTestJSON-1108582580-project Jun 16 00:36:28.791147 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:36:28.791147 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Instance 00ed7f8e-6608-40b3-81a1-31e9aa723fcf could not be found. Jun 16 00:36:28.791147 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': '00ed7f8e-6608-40b3-81a1-31e9aa723fcf'} Jun 16 00:36:28.791979 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:36:28.791979 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:28.791979 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:36:28.791979 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:36:28.791979 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:36:28.791979 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:36:28.791979 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:36:28.791979 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:36:28.791979 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:36:28.791979 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:36:28.791979 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00ed7f8e-6608-40b3-81a1-31e9aa723fcf could not be found. Jun 16 00:36:28.791979 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:36:28.791979 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:28.791979 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:36:28.791979 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:28.791979 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:28.791979 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:28.791979 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:36:28.791979 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:36:28.791979 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:36:28.793448 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:36:28.793448 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:36:28.793448 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:36:28.793448 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:36:28.793448 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:36:28.793448 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:36:28.793448 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:36:28.793448 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00ed7f8e-6608-40b3-81a1-31e9aa723fcf could not be found. Jun 16 00:36:28.793448 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:36:28.793448 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:28.793448 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:36:28.793448 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:28.793448 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:28.793448 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:28.793448 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:36:28.793448 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:36:28.793448 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00ed7f8e-6608-40b3-81a1-31e9aa723fcf could not be found. Jun 16 00:36:28.793448 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:36:28.795139 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-3aaff0a4-41e4-47cf-a198-5eac4f15b027 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Returning 404 to user: Instance 00ed7f8e-6608-40b3-81a1-31e9aa723fcf could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:36:28.795139 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-3aaff0a4-41e4-47cf-a198-5eac4f15b027 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf" status: 404 len: 111 microversion: 2.1 time: 0.030509 Jun 16 00:36:28.795139 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 459/905] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:28 2022] GET /compute/v2.1/servers/00ed7f8e-6608-40b3-81a1-31e9aa723fcf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:36:28.957573 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-66014e53-a07a-464e-9eb6-c053709adfea tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:28.958305 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-66014e53-a07a-464e-9eb6-c053709adfea tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:28.966955 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-66014e53-a07a-464e-9eb6-c053709adfea tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:28.967524 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-66014e53-a07a-464e-9eb6-c053709adfea tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:28.968326 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-66014e53-a07a-464e-9eb6-c053709adfea tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:28.968758 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-66014e53-a07a-464e-9eb6-c053709adfea tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:29.106372 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-66014e53-a07a-464e-9eb6-c053709adfea tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:29.114354 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-66014e53-a07a-464e-9eb6-c053709adfea tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1267 microversion: 2.1 time: 0.160722 Jun 16 00:36:29.114910 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 447/906] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:28 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:30.131361 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-9a088b99-7c96-4ee2-92b7-b7c21e9f7646 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:30.131959 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-9a088b99-7c96-4ee2-92b7-b7c21e9f7646 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:30.139138 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9a088b99-7c96-4ee2-92b7-b7c21e9f7646 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:30.139571 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9a088b99-7c96-4ee2-92b7-b7c21e9f7646 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:30.140312 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9a088b99-7c96-4ee2-92b7-b7c21e9f7646 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:30.140738 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9a088b99-7c96-4ee2-92b7-b7c21e9f7646 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:30.272348 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-9a088b99-7c96-4ee2-92b7-b7c21e9f7646 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:30.280832 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-9a088b99-7c96-4ee2-92b7-b7c21e9f7646 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1267 microversion: 2.1 time: 0.153280 Jun 16 00:36:30.281611 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 460/907] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:30 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:31.299439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-f1f865ca-38ef-4788-a93a-13ea3d78d3d7 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:31.299947 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-f1f865ca-38ef-4788-a93a-13ea3d78d3d7 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:31.306420 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f1f865ca-38ef-4788-a93a-13ea3d78d3d7 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:31.306865 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f1f865ca-38ef-4788-a93a-13ea3d78d3d7 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:31.307621 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f1f865ca-38ef-4788-a93a-13ea3d78d3d7 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:31.308050 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f1f865ca-38ef-4788-a93a-13ea3d78d3d7 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:31.438157 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f1f865ca-38ef-4788-a93a-13ea3d78d3d7 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:31.445493 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-f1f865ca-38ef-4788-a93a-13ea3d78d3d7 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1267 microversion: 2.1 time: 0.151075 Jun 16 00:36:31.446084 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 448/908] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:31 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:32.462231 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-beff5083-15a3-40fb-8dbd-75c5c7bddd5b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:32.462832 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-beff5083-15a3-40fb-8dbd-75c5c7bddd5b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:32.469956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-beff5083-15a3-40fb-8dbd-75c5c7bddd5b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:32.470395 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-beff5083-15a3-40fb-8dbd-75c5c7bddd5b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:32.471140 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-beff5083-15a3-40fb-8dbd-75c5c7bddd5b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:32.471566 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-beff5083-15a3-40fb-8dbd-75c5c7bddd5b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:32.609439 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-beff5083-15a3-40fb-8dbd-75c5c7bddd5b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:32.616802 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-beff5083-15a3-40fb-8dbd-75c5c7bddd5b tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1454 microversion: 2.1 time: 0.158662 Jun 16 00:36:32.617391 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 461/909] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:32 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:32.632943 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d22423e9-16d8-483c-9222-2c0dbb1bcf9d tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:32.633554 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d22423e9-16d8-483c-9222-2c0dbb1bcf9d tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:32.640927 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d22423e9-16d8-483c-9222-2c0dbb1bcf9d tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:32.641377 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d22423e9-16d8-483c-9222-2c0dbb1bcf9d tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:32.642130 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d22423e9-16d8-483c-9222-2c0dbb1bcf9d tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:32.642561 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d22423e9-16d8-483c-9222-2c0dbb1bcf9d tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:32.773984 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d22423e9-16d8-483c-9222-2c0dbb1bcf9d tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:32.782116 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d22423e9-16d8-483c-9222-2c0dbb1bcf9d tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1454 microversion: 2.1 time: 0.153045 Jun 16 00:36:32.782671 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 449/910] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:32 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:34.369399 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-28e43e2d-044f-4c77-9903-f5293dc88770 req-e29d2a4a-d208-4713-b2b8-3edc7db33d26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8", "tag": "37d0519d-bed0-4032-aef6-086b99f07e85"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:34.377871 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-28e43e2d-044f-4c77-9903-f5293dc88770 req-e29d2a4a-d208-4713-b2b8-3edc7db33d26 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:34.378304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-28e43e2d-044f-4c77-9903-f5293dc88770 req-e29d2a4a-d208-4713-b2b8-3edc7db33d26 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:34.389964 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-28e43e2d-044f-4c77-9903-f5293dc88770 req-e29d2a4a-d208-4713-b2b8-3edc7db33d26 service nova] Creating event network-changed:37d0519d-bed0-4032-aef6-086b99f07e85 for instance 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 on hv-cinder-84599 Jun 16 00:36:34.394875 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-28e43e2d-044f-4c77-9903-f5293dc88770 req-e29d2a4a-d208-4713-b2b8-3edc7db33d26 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029102 Jun 16 00:36:34.395659 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 462/911] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:36.543682 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5dc9f00e-ad98-4025-b18b-47d5b18321d9 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1511209901", "imageRef": "d9a6de24-7a5e-4f8b-b078-809c87b15d56", "flavorRef": "452", "networks": [{"uuid": "5f0f190e-1ad8-461e-95ff-976dcb7a032c"}]}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:36.596179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.network.neutron [None req-5dc9f00e-ad98-4025-b18b-47d5b18321d9 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] validate_networks() for [('5f0f190e-1ad8-461e-95ff-976dcb7a032c', None, None, None, None, None)] {{(pid=124230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:36:36.941197 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-5dc9f00e-ad98-4025-b18b-47d5b18321d9 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Flavor limits 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:36:36.941621 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-5dc9f00e-ad98-4025-b18b-47d5b18321d9 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Image limits 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:36:36.942094 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-5dc9f00e-ad98-4025-b18b-47d5b18321d9 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Flavor pref 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:36:36.942522 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-5dc9f00e-ad98-4025-b18b-47d5b18321d9 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Image pref 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:36:36.942932 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-5dc9f00e-ad98-4025-b18b-47d5b18321d9 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:36:36.952247 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5dc9f00e-ad98-4025-b18b-47d5b18321d9 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:36.952689 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5dc9f00e-ad98-4025-b18b-47d5b18321d9 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:36.953510 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5dc9f00e-ad98-4025-b18b-47d5b18321d9 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:36.953940 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5dc9f00e-ad98-4025-b18b-47d5b18321d9 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:36.961007 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-e87dede8-6dbc-421e-bb45-a0b797b4514e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:36.961581 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-e87dede8-6dbc-421e-bb45-a0b797b4514e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:36.968264 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e87dede8-6dbc-421e-bb45-a0b797b4514e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:36.968705 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e87dede8-6dbc-421e-bb45-a0b797b4514e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:36.969485 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e87dede8-6dbc-421e-bb45-a0b797b4514e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:36.970090 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e87dede8-6dbc-421e-bb45-a0b797b4514e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:36.971644 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-5dc9f00e-ad98-4025-b18b-47d5b18321d9 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Getting quotas for project 8dd0505146da40efbb028199390f8c75. Resources: {'ram', 'cores', 'instances'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:36:36.975599 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-5dc9f00e-ad98-4025-b18b-47d5b18321d9 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Getting quotas for user f77cfd6c2be6487e9701e08340c6c792 and project 8dd0505146da40efbb028199390f8c75. Resources: {'ram', 'cores', 'instances'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:36:36.987551 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-5dc9f00e-ad98-4025-b18b-47d5b18321d9 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Going to run 1 instances... {{(pid=124230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:36:36.989793 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-5dc9f00e-ad98-4025-b18b-47d5b18321d9 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 7c40332e-ae77-4288-a12f-bf5719613917] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d9a6de24-7a5e-4f8b-b078-809c87b15d56',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:36:36.995471 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-e87dede8-6dbc-421e-bb45-a0b797b4514e tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/ips" status: 200 len: 144 microversion: 2.1 time: 0.038667 Jun 16 00:36:36.996616 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 463/912] 10.222.0.23 () {58 vars in 1247 bytes} [Thu Jun 16 00:36:36 2022] GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/ips => generated 144 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:36:37.037725 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-5dc9f00e-ad98-4025-b18b-47d5b18321d9 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497840 Jun 16 00:36:37.038541 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 450/913] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Jun 16 00:36:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:36:37.048460 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-455b31df-bfd1-4da1-a346-3baf5fd65f94 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:37.049095 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-455b31df-bfd1-4da1-a346-3baf5fd65f94 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 7c40332e-ae77-4288-a12f-bf5719613917] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:37.120668 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-455b31df-bfd1-4da1-a346-3baf5fd65f94 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:37.127402 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-455b31df-bfd1-4da1-a346-3baf5fd65f94 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917" status: 200 len: 1219 microversion: 2.1 time: 0.082937 Jun 16 00:36:37.127962 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 464/914] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:37 2022] GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:38.145048 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-aba33efa-a738-4cba-86fe-108461d975ea tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:38.145655 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-aba33efa-a738-4cba-86fe-108461d975ea tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 7c40332e-ae77-4288-a12f-bf5719613917] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:38.152217 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-aba33efa-a738-4cba-86fe-108461d975ea tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:38.152655 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-aba33efa-a738-4cba-86fe-108461d975ea tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:38.153440 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-aba33efa-a738-4cba-86fe-108461d975ea tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:38.153909 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-aba33efa-a738-4cba-86fe-108461d975ea tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:38.169610 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:38.222171 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-aba33efa-a738-4cba-86fe-108461d975ea tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:38.229716 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-aba33efa-a738-4cba-86fe-108461d975ea tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917" status: 200 len: 1277 microversion: 2.1 time: 0.088788 Jun 16 00:36:38.230273 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 451/915] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:38 2022] GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917 => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:38.341059 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-ba99457d-9c77-4dce-8794-409dba96beb3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17d4b4e4-803c-45c8-a46c-2ed0fd2799e0"}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:38.343617 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-ba99457d-9c77-4dce-8794-409dba96beb3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:38.351960 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ba99457d-9c77-4dce-8794-409dba96beb3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:38.352408 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ba99457d-9c77-4dce-8794-409dba96beb3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:38.353233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ba99457d-9c77-4dce-8794-409dba96beb3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:38.353664 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ba99457d-9c77-4dce-8794-409dba96beb3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:38.611003 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-ba99457d-9c77-4dce-8794-409dba96beb3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "POST /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274012 Jun 16 00:36:38.617206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 465/916] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Jun 16 00:36:38 2022] POST /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:39.248540 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5fd6b201-79e6-46bf-89ea-f8c1f2b1f700 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:39.250606 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-5fd6b201-79e6-46bf-89ea-f8c1f2b1f700 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 7c40332e-ae77-4288-a12f-bf5719613917] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:39.258986 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5fd6b201-79e6-46bf-89ea-f8c1f2b1f700 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:39.259538 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5fd6b201-79e6-46bf-89ea-f8c1f2b1f700 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:39.260418 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5fd6b201-79e6-46bf-89ea-f8c1f2b1f700 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:39.261009 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5fd6b201-79e6-46bf-89ea-f8c1f2b1f700 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:39.304978 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-af73ff78-2215-4c04-b605-138f81044043 req-2fd068ac-154a-4c35-aa7e-a27d651db4ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c40332e-ae77-4288-a12f-bf5719613917", "tag": "08171c54-eff1-46ed-8192-9047c2253fe8"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:39.324465 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-af73ff78-2215-4c04-b605-138f81044043 req-2fd068ac-154a-4c35-aa7e-a27d651db4ed service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:39.325277 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-af73ff78-2215-4c04-b605-138f81044043 req-2fd068ac-154a-4c35-aa7e-a27d651db4ed service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:39.338530 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-af73ff78-2215-4c04-b605-138f81044043 req-2fd068ac-154a-4c35-aa7e-a27d651db4ed service nova] Creating event network-changed:08171c54-eff1-46ed-8192-9047c2253fe8 for instance 7c40332e-ae77-4288-a12f-bf5719613917 on hv-cinder-84599 Jun 16 00:36:39.343763 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-af73ff78-2215-4c04-b605-138f81044043 req-2fd068ac-154a-4c35-aa7e-a27d651db4ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050831 Jun 16 00:36:39.345449 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 466/917] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:36:39.414573 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-5fd6b201-79e6-46bf-89ea-f8c1f2b1f700 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:39.422279 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-5fd6b201-79e6-46bf-89ea-f8c1f2b1f700 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917" status: 200 len: 1319 microversion: 2.1 time: 0.178875 Jun 16 00:36:39.422854 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 452/918] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:39 2022] GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:40.440033 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-61031b90-0ff8-4212-b019-c608c43a27df tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:40.440724 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-61031b90-0ff8-4212-b019-c608c43a27df tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 7c40332e-ae77-4288-a12f-bf5719613917] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:40.446935 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-61031b90-0ff8-4212-b019-c608c43a27df tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:40.447390 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-61031b90-0ff8-4212-b019-c608c43a27df tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:40.448144 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-61031b90-0ff8-4212-b019-c608c43a27df tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:40.448575 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-61031b90-0ff8-4212-b019-c608c43a27df tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:40.584383 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-61031b90-0ff8-4212-b019-c608c43a27df tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:40.593742 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-61031b90-0ff8-4212-b019-c608c43a27df tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917" status: 200 len: 1319 microversion: 2.1 time: 0.158408 Jun 16 00:36:40.594313 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 467/919] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:40 2022] GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:41.611390 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c9991dcc-7eab-4d7f-b3ab-0ff293d7f33e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:41.612153 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c9991dcc-7eab-4d7f-b3ab-0ff293d7f33e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 7c40332e-ae77-4288-a12f-bf5719613917] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:41.618698 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c9991dcc-7eab-4d7f-b3ab-0ff293d7f33e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:41.619146 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c9991dcc-7eab-4d7f-b3ab-0ff293d7f33e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:41.619908 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c9991dcc-7eab-4d7f-b3ab-0ff293d7f33e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:41.620411 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c9991dcc-7eab-4d7f-b3ab-0ff293d7f33e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:41.752257 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c9991dcc-7eab-4d7f-b3ab-0ff293d7f33e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:41.759620 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c9991dcc-7eab-4d7f-b3ab-0ff293d7f33e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917" status: 200 len: 1319 microversion: 2.1 time: 0.152966 Jun 16 00:36:41.760176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 453/920] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:41 2022] GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:42.776343 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-197327bf-b50b-4f11-b0dd-3bf40598e724 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:42.776972 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-197327bf-b50b-4f11-b0dd-3bf40598e724 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 7c40332e-ae77-4288-a12f-bf5719613917] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:42.785110 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-197327bf-b50b-4f11-b0dd-3bf40598e724 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:42.785562 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-197327bf-b50b-4f11-b0dd-3bf40598e724 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:42.786325 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-197327bf-b50b-4f11-b0dd-3bf40598e724 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:42.786755 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-197327bf-b50b-4f11-b0dd-3bf40598e724 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:42.802553 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:42.920161 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-197327bf-b50b-4f11-b0dd-3bf40598e724 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:42.927601 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-197327bf-b50b-4f11-b0dd-3bf40598e724 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917" status: 200 len: 1319 microversion: 2.1 time: 0.155225 Jun 16 00:36:42.928146 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 468/921] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:42 2022] GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:43.317226 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-bee4bb95-de77-418b-b2b6-f8653227fe9b req-bf1f13c1-0c1c-4b8f-8bfd-b46d62c20658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c40332e-ae77-4288-a12f-bf5719613917", "name": "network-vif-plugged", "status": "completed", "tag": "08171c54-eff1-46ed-8192-9047c2253fe8"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:43.327825 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-bee4bb95-de77-418b-b2b6-f8653227fe9b req-bf1f13c1-0c1c-4b8f-8bfd-b46d62c20658 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:43.328272 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-bee4bb95-de77-418b-b2b6-f8653227fe9b req-bf1f13c1-0c1c-4b8f-8bfd-b46d62c20658 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:43.339771 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-bee4bb95-de77-418b-b2b6-f8653227fe9b req-bf1f13c1-0c1c-4b8f-8bfd-b46d62c20658 service nova] Creating event network-vif-plugged:08171c54-eff1-46ed-8192-9047c2253fe8 for instance 7c40332e-ae77-4288-a12f-bf5719613917 on hv-cinder-84599 Jun 16 00:36:43.345977 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-bee4bb95-de77-418b-b2b6-f8653227fe9b req-bf1f13c1-0c1c-4b8f-8bfd-b46d62c20658 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032435 Jun 16 00:36:43.346571 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 454/922] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:36:43.943511 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-0f1d9e01-deb7-4d57-a6da-37aedb09bd4f tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:43.944148 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-0f1d9e01-deb7-4d57-a6da-37aedb09bd4f tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 7c40332e-ae77-4288-a12f-bf5719613917] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:43.951372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0f1d9e01-deb7-4d57-a6da-37aedb09bd4f tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:43.951827 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0f1d9e01-deb7-4d57-a6da-37aedb09bd4f tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:43.952596 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0f1d9e01-deb7-4d57-a6da-37aedb09bd4f tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:43.953073 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0f1d9e01-deb7-4d57-a6da-37aedb09bd4f tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:44.089394 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-0f1d9e01-deb7-4d57-a6da-37aedb09bd4f tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:44.097385 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-0f1d9e01-deb7-4d57-a6da-37aedb09bd4f tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917" status: 200 len: 1319 microversion: 2.1 time: 0.157749 Jun 16 00:36:44.097941 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 469/923] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:43 2022] GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:45.114908 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-10c5c9da-a535-4c9c-9435-4dee6ff031cc tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:45.115630 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-10c5c9da-a535-4c9c-9435-4dee6ff031cc tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 7c40332e-ae77-4288-a12f-bf5719613917] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:45.121913 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-10c5c9da-a535-4c9c-9435-4dee6ff031cc tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:45.122369 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-10c5c9da-a535-4c9c-9435-4dee6ff031cc tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:45.123114 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-10c5c9da-a535-4c9c-9435-4dee6ff031cc tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:45.123547 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-10c5c9da-a535-4c9c-9435-4dee6ff031cc tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:45.254516 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-10c5c9da-a535-4c9c-9435-4dee6ff031cc tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:45.262022 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-10c5c9da-a535-4c9c-9435-4dee6ff031cc tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917" status: 200 len: 1508 microversion: 2.1 time: 0.151809 Jun 16 00:36:45.262593 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 455/924] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:45 2022] GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:45.278994 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-ca259082-9653-4202-8ce9-4d0254c46d74 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71b92615-a7f1-47ce-b1f8-abbaa74bb381", "device": "/dev/sdb"}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:45.280562 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-ca259082-9653-4202-8ce9-4d0254c46d74 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 7c40332e-ae77-4288-a12f-bf5719613917] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:45.287065 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ca259082-9653-4202-8ce9-4d0254c46d74 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:45.287514 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ca259082-9653-4202-8ce9-4d0254c46d74 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:45.288275 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ca259082-9653-4202-8ce9-4d0254c46d74 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:45.288709 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ca259082-9653-4202-8ce9-4d0254c46d74 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:45.697807 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-ca259082-9653-4202-8ce9-4d0254c46d74 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "POST /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.422563 Jun 16 00:36:45.698428 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 470/925] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Jun 16 00:36:45 2022] POST /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:46.130353 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-bf488053-84c3-473b-97eb-1f1e1ce6dc28 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:46.131349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-bf488053-84c3-473b-97eb-1f1e1ce6dc28 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:46.140446 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bf488053-84c3-473b-97eb-1f1e1ce6dc28 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:46.141136 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bf488053-84c3-473b-97eb-1f1e1ce6dc28 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:46.142438 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bf488053-84c3-473b-97eb-1f1e1ce6dc28 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:46.142885 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bf488053-84c3-473b-97eb-1f1e1ce6dc28 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:46.175181 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-bf488053-84c3-473b-97eb-1f1e1ce6dc28 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048712 Jun 16 00:36:46.175743 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 456/926] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Jun 16 00:36:46 2022] GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:46.187004 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-607e5640-ba7e-4a0b-9ed3-4a8a1283fed0 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:46.187580 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-607e5640-ba7e-4a0b-9ed3-4a8a1283fed0 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:46.189535 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=46 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:46.196396 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-607e5640-ba7e-4a0b-9ed3-4a8a1283fed0 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:46.197212 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-607e5640-ba7e-4a0b-9ed3-4a8a1283fed0 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:46.198020 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-607e5640-ba7e-4a0b-9ed3-4a8a1283fed0 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:46.198473 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-607e5640-ba7e-4a0b-9ed3-4a8a1283fed0 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:46.230578 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-607e5640-ba7e-4a0b-9ed3-4a8a1283fed0 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-volume_attachments/17d4b4e4-803c-45c8-a46c-2ed0fd2799e0" status: 200 len: 194 microversion: 2.1 time: 0.048451 Jun 16 00:36:46.231173 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 471/927] 10.222.0.23 () {58 vars in 1412 bytes} [Thu Jun 16 00:36:46 2022] GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-volume_attachments/17d4b4e4-803c-45c8-a46c-2ed0fd2799e0 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:47.571444 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-71a3c63f-d8dc-4bc1-9a81-b30c2d5db8d3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f2eab0c-b6d3-4317-abf7-65581c5bd5b8"}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:47.572499 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-71a3c63f-d8dc-4bc1-9a81-b30c2d5db8d3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:47.574436 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=2 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:47.575088 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=6 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:47.577062 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:47.583575 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-71a3c63f-d8dc-4bc1-9a81-b30c2d5db8d3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:47.584021 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-71a3c63f-d8dc-4bc1-9a81-b30c2d5db8d3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:47.584777 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-71a3c63f-d8dc-4bc1-9a81-b30c2d5db8d3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:47.585236 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-71a3c63f-d8dc-4bc1-9a81-b30c2d5db8d3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:47.829868 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-71a3c63f-d8dc-4bc1-9a81-b30c2d5db8d3 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "POST /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262153 Jun 16 00:36:47.830475 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 457/928] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Jun 16 00:36:47 2022] POST /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:37:00.611852 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-0d0a140f-b5f4-41fc-9555-dc4164882988 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:00.612860 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-0d0a140f-b5f4-41fc-9555-dc4164882988 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:00.615244 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=2 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:00.616060 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:00.616721 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:00.623493 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0d0a140f-b5f4-41fc-9555-dc4164882988 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:00.624530 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0d0a140f-b5f4-41fc-9555-dc4164882988 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:00.625329 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0d0a140f-b5f4-41fc-9555-dc4164882988 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:00.625761 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0d0a140f-b5f4-41fc-9555-dc4164882988 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:00.662029 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-0d0a140f-b5f4-41fc-9555-dc4164882988 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054618 Jun 16 00:37:00.662763 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 472/929] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Jun 16 00:37:00 2022] GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:37:00.803714 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=1 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:00.804569 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:00.808870 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-ba7defd5-1bb1-4c13-a70e-9cce89fbc66c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:00.809482 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-ba7defd5-1bb1-4c13-a70e-9cce89fbc66c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:00.818156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ba7defd5-1bb1-4c13-a70e-9cce89fbc66c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:00.818604 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ba7defd5-1bb1-4c13-a70e-9cce89fbc66c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:00.819367 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ba7defd5-1bb1-4c13-a70e-9cce89fbc66c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:00.819803 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ba7defd5-1bb1-4c13-a70e-9cce89fbc66c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:00.850367 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-ba7defd5-1bb1-4c13-a70e-9cce89fbc66c tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-volume_attachments/17d4b4e4-803c-45c8-a46c-2ed0fd2799e0" status: 200 len: 194 microversion: 2.1 time: 0.048132 Jun 16 00:37:00.850952 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 458/930] 10.222.0.23 () {58 vars in 1412 bytes} [Thu Jun 16 00:37:00 2022] GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-volume_attachments/17d4b4e4-803c-45c8-a46c-2ed0fd2799e0 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:37:00.861516 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d2314e91-0639-487d-8285-34d4a1fe72ca tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:00.862006 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-d2314e91-0639-487d-8285-34d4a1fe72ca tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:00.868191 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d2314e91-0639-487d-8285-34d4a1fe72ca tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:00.868720 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d2314e91-0639-487d-8285-34d4a1fe72ca tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:00.869601 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d2314e91-0639-487d-8285-34d4a1fe72ca tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:00.870062 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d2314e91-0639-487d-8285-34d4a1fe72ca tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:00.950069 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.objects.instance [None req-d2314e91-0639-487d-8285-34d4a1fe72ca tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lazy-loading 'services' on Instance uuid eb6aeebb-bf67-4347-bd45-ea06175e8939 {{(pid=124231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:37:01.020192 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-d2314e91-0639-487d-8285-34d4a1fe72ca tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "DELETE /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-volume_attachments/17d4b4e4-803c-45c8-a46c-2ed0fd2799e0" status: 202 len: 0 microversion: 2.1 time: 0.163248 Jun 16 00:37:01.020758 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 473/931] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Jun 16 00:37:00 2022] DELETE /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-volume_attachments/17d4b4e4-803c-45c8-a46c-2ed0fd2799e0 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 00:37:02.130649 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8133ccf3-2f3e-4236-ba94-82ac431ec074 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:02.131253 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-8133ccf3-2f3e-4236-ba94-82ac431ec074 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:02.137923 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8133ccf3-2f3e-4236-ba94-82ac431ec074 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:02.138622 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8133ccf3-2f3e-4236-ba94-82ac431ec074 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:02.139519 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8133ccf3-2f3e-4236-ba94-82ac431ec074 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:02.140201 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8133ccf3-2f3e-4236-ba94-82ac431ec074 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:02.169433 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-8133ccf3-2f3e-4236-ba94-82ac431ec074 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-volume_attachments/6f2eab0c-b6d3-4317-abf7-65581c5bd5b8" status: 200 len: 194 microversion: 2.1 time: 0.042696 Jun 16 00:37:02.170041 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 459/932] 10.222.0.23 () {58 vars in 1412 bytes} [Thu Jun 16 00:37:02 2022] GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-volume_attachments/6f2eab0c-b6d3-4317-abf7-65581c5bd5b8 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:37:02.181528 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-8a3882da-df1d-404c-b8ba-b2423e563d95 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:02.182102 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-8a3882da-df1d-404c-b8ba-b2423e563d95 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:02.189065 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8a3882da-df1d-404c-b8ba-b2423e563d95 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:02.189510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8a3882da-df1d-404c-b8ba-b2423e563d95 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:02.190260 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8a3882da-df1d-404c-b8ba-b2423e563d95 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:02.190684 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8a3882da-df1d-404c-b8ba-b2423e563d95 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:02.380848 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.objects.instance [None req-8a3882da-df1d-404c-b8ba-b2423e563d95 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lazy-loading 'services' on Instance uuid eb6aeebb-bf67-4347-bd45-ea06175e8939 {{(pid=124231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:37:02.451105 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-8a3882da-df1d-404c-b8ba-b2423e563d95 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "DELETE /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-volume_attachments/6f2eab0c-b6d3-4317-abf7-65581c5bd5b8" status: 202 len: 0 microversion: 2.1 time: 0.274068 Jun 16 00:37:02.451721 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 474/933] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Jun 16 00:37:02 2022] DELETE /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-volume_attachments/6f2eab0c-b6d3-4317-abf7-65581c5bd5b8 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:37:03.613632 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d9cf0e84-0827-4c24-bbeb-674f447f45e5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:03.614582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d9cf0e84-0827-4c24-bbeb-674f447f45e5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:03.621485 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d9cf0e84-0827-4c24-bbeb-674f447f45e5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:03.621987 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d9cf0e84-0827-4c24-bbeb-674f447f45e5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:03.622787 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d9cf0e84-0827-4c24-bbeb-674f447f45e5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:03.623242 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d9cf0e84-0827-4c24-bbeb-674f447f45e5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:03.652139 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d9cf0e84-0827-4c24-bbeb-674f447f45e5 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042482 Jun 16 00:37:03.652687 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 460/934] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Jun 16 00:37:03 2022] GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:37:03.757047 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-06dbcddc-7780-4b2c-9d12-4f4b1cfa3f86 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:03.758096 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-06dbcddc-7780-4b2c-9d12-4f4b1cfa3f86 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:03.765109 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-06dbcddc-7780-4b2c-9d12-4f4b1cfa3f86 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:03.765490 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-06dbcddc-7780-4b2c-9d12-4f4b1cfa3f86 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:03.766235 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-06dbcddc-7780-4b2c-9d12-4f4b1cfa3f86 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:03.766659 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-06dbcddc-7780-4b2c-9d12-4f4b1cfa3f86 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:03.794587 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-06dbcddc-7780-4b2c-9d12-4f4b1cfa3f86 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042291 Jun 16 00:37:03.795129 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 475/935] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Jun 16 00:37:03 2022] GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:37:03.851909 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-2da28bce-7f68-48a6-a306-994c67ec23fe tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:03.852425 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-2da28bce-7f68-48a6-a306-994c67ec23fe tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:03.858557 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2da28bce-7f68-48a6-a306-994c67ec23fe tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:03.859008 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2da28bce-7f68-48a6-a306-994c67ec23fe tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:03.859769 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2da28bce-7f68-48a6-a306-994c67ec23fe tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:03.860214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2da28bce-7f68-48a6-a306-994c67ec23fe tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:03.885162 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-2da28bce-7f68-48a6-a306-994c67ec23fe tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Going to try to terminate instance {{(pid=124230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:37:03.959297 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-2da28bce-7f68-48a6-a306-994c67ec23fe tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "DELETE /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939" status: 204 len: 0 microversion: 2.1 time: 0.110790 Jun 16 00:37:03.960516 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 461/936] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:37:03 2022] DELETE /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:37:03.968262 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-3425cb3b-2e53-49ef-bef2-073c2744d09d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:03.969051 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-3425cb3b-2e53-49ef-bef2-073c2744d09d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:03.975013 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3425cb3b-2e53-49ef-bef2-073c2744d09d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:03.975450 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3425cb3b-2e53-49ef-bef2-073c2744d09d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:03.976371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3425cb3b-2e53-49ef-bef2-073c2744d09d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:03.976800 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3425cb3b-2e53-49ef-bef2-073c2744d09d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:03.986239 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-89af2b9c-65c8-4270-974a-e23ea486085e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:03.986893 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-89af2b9c-65c8-4270-974a-e23ea486085e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 7c40332e-ae77-4288-a12f-bf5719613917] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:03.993293 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-89af2b9c-65c8-4270-974a-e23ea486085e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:03.993740 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-89af2b9c-65c8-4270-974a-e23ea486085e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:03.994554 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-89af2b9c-65c8-4270-974a-e23ea486085e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:03.994988 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-89af2b9c-65c8-4270-974a-e23ea486085e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:04.112184 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-3425cb3b-2e53-49ef-bef2-073c2744d09d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:04.119715 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-3425cb3b-2e53-49ef-bef2-073c2744d09d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939" status: 200 len: 1672 microversion: 2.1 time: 0.155430 Jun 16 00:37:04.120586 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 476/937] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:03 2022] GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:04.129059 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.objects.instance [None req-89af2b9c-65c8-4270-974a-e23ea486085e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lazy-loading 'services' on Instance uuid 7c40332e-ae77-4288-a12f-bf5719613917 {{(pid=124230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:37:04.201095 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-89af2b9c-65c8-4270-974a-e23ea486085e tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917/os-volume_attachments/71b92615-a7f1-47ce-b1f8-abbaa74bb381" status: 202 len: 0 microversion: 2.1 time: 0.218911 Jun 16 00:37:04.201711 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 462/938] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Jun 16 00:37:03 2022] DELETE /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917/os-volume_attachments/71b92615-a7f1-47ce-b1f8-abbaa74bb381 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 00:37:05.137153 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-72b3a26c-635a-464c-b2de-1926fdbaf9ac tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:05.137784 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-72b3a26c-635a-464c-b2de-1926fdbaf9ac tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:05.144673 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-72b3a26c-635a-464c-b2de-1926fdbaf9ac tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:05.145141 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-72b3a26c-635a-464c-b2de-1926fdbaf9ac tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:05.145890 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-72b3a26c-635a-464c-b2de-1926fdbaf9ac tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:05.146324 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-72b3a26c-635a-464c-b2de-1926fdbaf9ac tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:05.276279 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-72b3a26c-635a-464c-b2de-1926fdbaf9ac tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:05.283771 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-72b3a26c-635a-464c-b2de-1926fdbaf9ac tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939" status: 200 len: 1672 microversion: 2.1 time: 0.150476 Jun 16 00:37:05.284326 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 477/939] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:05 2022] GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:06.302217 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-29e1798b-fe16-4253-977f-a0a3b7ae400d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:06.302987 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-29e1798b-fe16-4253-977f-a0a3b7ae400d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:06.309401 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-29e1798b-fe16-4253-977f-a0a3b7ae400d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:06.309852 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-29e1798b-fe16-4253-977f-a0a3b7ae400d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:06.318995 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-29e1798b-fe16-4253-977f-a0a3b7ae400d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:06.319542 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-29e1798b-fe16-4253-977f-a0a3b7ae400d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:06.489793 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-29e1798b-fe16-4253-977f-a0a3b7ae400d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5985474b0774d8ea0e62718de767310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cc2e1e741d4eeb849e07d9f2c371be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:06.497407 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-29e1798b-fe16-4253-977f-a0a3b7ae400d tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939" status: 200 len: 1672 microversion: 2.1 time: 0.200103 Jun 16 00:37:06.498007 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 463/940] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:06 2022] GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939 => generated 1672 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:07.003604 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-b422c379-a98d-49de-a705-6df4841f4187 req-f8c20fbb-4808-4aad-8e79-0121e2719b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6aeebb-bf67-4347-bd45-ea06175e8939", "name": "network-vif-deleted", "tag": "fc37c1ff-52e8-48de-b41a-ec5a181200f5"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:37:07.013828 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-b422c379-a98d-49de-a705-6df4841f4187 req-f8c20fbb-4808-4aad-8e79-0121e2719b05 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:07.015055 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-b422c379-a98d-49de-a705-6df4841f4187 req-f8c20fbb-4808-4aad-8e79-0121e2719b05 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:07.028210 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-b422c379-a98d-49de-a705-6df4841f4187 req-f8c20fbb-4808-4aad-8e79-0121e2719b05 service nova] Creating event network-vif-deleted:fc37c1ff-52e8-48de-b41a-ec5a181200f5 for instance eb6aeebb-bf67-4347-bd45-ea06175e8939 on hv-cinder-84599 Jun 16 00:37:07.033654 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-b422c379-a98d-49de-a705-6df4841f4187 req-f8c20fbb-4808-4aad-8e79-0121e2719b05 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033764 Jun 16 00:37:07.034367 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 478/941] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:37:07.449872 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-4bca88af-6b3d-4a55-95c4-9897388574ce tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:07.450443 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-4bca88af-6b3d-4a55-95c4-9897388574ce tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 7c40332e-ae77-4288-a12f-bf5719613917] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:07.458718 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4bca88af-6b3d-4a55-95c4-9897388574ce tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:07.459195 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4bca88af-6b3d-4a55-95c4-9897388574ce tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:07.459956 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4bca88af-6b3d-4a55-95c4-9897388574ce tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:07.460447 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4bca88af-6b3d-4a55-95c4-9897388574ce tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:07.491328 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-4bca88af-6b3d-4a55-95c4-9897388574ce tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 7c40332e-ae77-4288-a12f-bf5719613917] Going to try to terminate instance {{(pid=124230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:37:07.517636 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-637aa623-db2c-4277-ad6f-d4888b89e3e6 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:07.518890 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-637aa623-db2c-4277-ad6f-d4888b89e3e6 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:07.528754 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-637aa623-db2c-4277-ad6f-d4888b89e3e6 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:07.529276 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-637aa623-db2c-4277-ad6f-d4888b89e3e6 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:07.530124 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-637aa623-db2c-4277-ad6f-d4888b89e3e6 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:07.530839 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-637aa623-db2c-4277-ad6f-d4888b89e3e6 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:07.544741 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-637aa623-db2c-4277-ad6f-d4888b89e3e6 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] HTTP exception thrown: Instance eb6aeebb-bf67-4347-bd45-ea06175e8939 could not be found. Jun 16 00:37:07.547238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-637aa623-db2c-4277-ad6f-d4888b89e3e6 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Request method failure captured: Jun 16 00:37:07.547238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939 HTTP/1.1 Jun 16 00:37:07.547238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:37:07.547238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:37:07.547238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:37:07.547238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:37:07.547238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:37:07.547238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:37:07.547238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:37:07.547238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:37:07.547238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnoohqT51d1Og861drBVM1xT3p_YO-9Ywiwgdfnk41ZHtqwaCkHblNwVf0CcDS17ycAX4Q7GuugzikdHEKZC3dJA4z2IEyNcGKiMAYGoC7Gn6zonVVDjLc6O2cmS2ChJDYIUrCysOkv-f1SqjTvRN_64xm0mUUK9wpDNigH52-7iWLo Jun 16 00:37:07.547238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:37:07.547238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:37:07.547238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:37:07.547238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:37:07.547238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:37:07.547238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:37:07.547238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: d2cc2e1e741d4eeb849e07d9f2c371be Jun 16 00:37:07.547238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-AttachVolumeTestJSON-174631568 Jun 16 00:37:07.547238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:37:07.547238 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:37:07.548901 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:37:07.548901 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-AttachVolumeTestJSON-174631568 Jun 16 00:37:07.548901 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: d2cc2e1e741d4eeb849e07d9f2c371be Jun 16 00:37:07.548901 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-AttachVolumeTestJSON-174631568 Jun 16 00:37:07.548901 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-AttachVolumeTestJSON-174631568-project Jun 16 00:37:07.548901 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:37:07.548901 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:37:07.548901 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: d5985474b0774d8ea0e62718de767310 Jun 16 00:37:07.548901 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-AttachVolumeTestJSON-174631568-project Jun 16 00:37:07.548901 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:37:07.548901 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Instance eb6aeebb-bf67-4347-bd45-ea06175e8939 could not be found. Jun 16 00:37:07.548901 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': 'eb6aeebb-bf67-4347-bd45-ea06175e8939'} Jun 16 00:37:07.549745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:37:07.549745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:07.549745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:37:07.549745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:37:07.549745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:37:07.549745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:37:07.549745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:37:07.549745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:37:07.549745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:37:07.549745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:37:07.549745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6aeebb-bf67-4347-bd45-ea06175e8939 could not be found. Jun 16 00:37:07.549745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:07.549745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:07.549745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:07.549745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:07.549745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:07.549745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:07.549745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:37:07.549745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:37:07.549745 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:37:07.551227 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:37:07.551227 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:37:07.551227 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:37:07.551227 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:37:07.551227 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:37:07.551227 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:37:07.551227 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:37:07.551227 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6aeebb-bf67-4347-bd45-ea06175e8939 could not be found. Jun 16 00:37:07.551227 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:07.551227 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:07.551227 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:07.551227 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:07.551227 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:07.551227 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:07.551227 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:37:07.551227 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:37:07.551227 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6aeebb-bf67-4347-bd45-ea06175e8939 could not be found. Jun 16 00:37:07.551227 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:07.553282 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-637aa623-db2c-4277-ad6f-d4888b89e3e6 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Returning 404 to user: Instance eb6aeebb-bf67-4347-bd45-ea06175e8939 could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:37:07.554286 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-637aa623-db2c-4277-ad6f-d4888b89e3e6 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939" status: 404 len: 111 microversion: 2.1 time: 0.043383 Jun 16 00:37:07.554842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 479/942] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:07 2022] GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:37:07.564855 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-f5076fdd-6b65-4e20-a987-71af4a4bb504 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '.version_select at 0x7fe704a1a310>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:07.586656 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-f5076fdd-6b65-4e20-a987-71af4a4bb504 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-632416177" status: 202 len: 0 microversion: 2.1 time: 0.026879 Jun 16 00:37:07.587691 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 480/943] 10.222.0.23 () {58 vars in 1217 bytes} [Thu Jun 16 00:37:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-632416177 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 00:37:07.594398 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-4bca88af-6b3d-4a55-95c4-9897388574ce tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917" status: 204 len: 0 microversion: 2.1 time: 0.148324 Jun 16 00:37:07.595699 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 464/944] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:37:07 2022] DELETE /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:37:07.604522 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-899ee4f7-dbe0-4236-b9d2-cb9c52ff971a tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:07.605241 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-899ee4f7-dbe0-4236-b9d2-cb9c52ff971a tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 7c40332e-ae77-4288-a12f-bf5719613917] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:07.614459 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-899ee4f7-dbe0-4236-b9d2-cb9c52ff971a tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:07.614961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-899ee4f7-dbe0-4236-b9d2-cb9c52ff971a tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:07.615892 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-899ee4f7-dbe0-4236-b9d2-cb9c52ff971a tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:07.616316 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-899ee4f7-dbe0-4236-b9d2-cb9c52ff971a tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:07.792436 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-899ee4f7-dbe0-4236-b9d2-cb9c52ff971a tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:07.803117 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-899ee4f7-dbe0-4236-b9d2-cb9c52ff971a tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917" status: 200 len: 1514 microversion: 2.1 time: 0.203108 Jun 16 00:37:07.803746 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 481/945] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:07 2022] GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917 => generated 1514 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:37:08.821143 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-f2759e92-8a35-4e38-b48c-992afc228565 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:08.821835 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-f2759e92-8a35-4e38-b48c-992afc228565 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 7c40332e-ae77-4288-a12f-bf5719613917] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:08.828814 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f2759e92-8a35-4e38-b48c-992afc228565 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:08.829283 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f2759e92-8a35-4e38-b48c-992afc228565 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:08.830033 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f2759e92-8a35-4e38-b48c-992afc228565 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:08.830460 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f2759e92-8a35-4e38-b48c-992afc228565 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:08.965366 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f2759e92-8a35-4e38-b48c-992afc228565 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:08.973610 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-f2759e92-8a35-4e38-b48c-992afc228565 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917" status: 200 len: 1514 microversion: 2.1 time: 0.156699 Jun 16 00:37:08.974176 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 465/946] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:08 2022] GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:09.767011 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-7a221fb9-5a03-4078-b152-57250923746c req-68f3964b-4e30-4f7e-b3cd-e8ca144f2091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c40332e-ae77-4288-a12f-bf5719613917", "name": "network-vif-deleted", "tag": "08171c54-eff1-46ed-8192-9047c2253fe8"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:37:09.776380 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-7a221fb9-5a03-4078-b152-57250923746c req-68f3964b-4e30-4f7e-b3cd-e8ca144f2091 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:09.776851 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-7a221fb9-5a03-4078-b152-57250923746c req-68f3964b-4e30-4f7e-b3cd-e8ca144f2091 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:09.788766 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-7a221fb9-5a03-4078-b152-57250923746c req-68f3964b-4e30-4f7e-b3cd-e8ca144f2091 service nova] Creating event network-vif-deleted:08171c54-eff1-46ed-8192-9047c2253fe8 for instance 7c40332e-ae77-4288-a12f-bf5719613917 on hv-cinder-84599 Jun 16 00:37:09.794016 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-7a221fb9-5a03-4078-b152-57250923746c req-68f3964b-4e30-4f7e-b3cd-e8ca144f2091 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031754 Jun 16 00:37:09.794606 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 482/947] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:37:09.990430 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-a43ae399-cd8a-49ec-8f16-7b8406fb6464 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:09.990975 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-a43ae399-cd8a-49ec-8f16-7b8406fb6464 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 7c40332e-ae77-4288-a12f-bf5719613917] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:09.997553 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a43ae399-cd8a-49ec-8f16-7b8406fb6464 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:09.998503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a43ae399-cd8a-49ec-8f16-7b8406fb6464 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:09.999253 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a43ae399-cd8a-49ec-8f16-7b8406fb6464 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:09.999671 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a43ae399-cd8a-49ec-8f16-7b8406fb6464 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:10.030626 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a43ae399-cd8a-49ec-8f16-7b8406fb6464 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:10.031062 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-a43ae399-cd8a-49ec-8f16-7b8406fb6464 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:10.031503 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.objects.instance [None req-a43ae399-cd8a-49ec-8f16-7b8406fb6464 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lazy-loading 'fault' on Instance uuid 7c40332e-ae77-4288-a12f-bf5719613917 {{(pid=124230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:37:10.075203 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-a43ae399-cd8a-49ec-8f16-7b8406fb6464 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77cfd6c2be6487e9701e08340c6c792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0505146da40efbb028199390f8c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:10.083434 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-a43ae399-cd8a-49ec-8f16-7b8406fb6464 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917" status: 200 len: 1309 microversion: 2.1 time: 0.096966 Jun 16 00:37:10.083993 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 466/948] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:09 2022] GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:10.559892 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-05c9bf55-4d98-4b58-9b63-87ff4d3b7029 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:10.561209 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-05c9bf55-4d98-4b58-9b63-87ff4d3b7029 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:10.567521 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-05c9bf55-4d98-4b58-9b63-87ff4d3b7029 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:10.567967 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-05c9bf55-4d98-4b58-9b63-87ff4d3b7029 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:10.568723 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-05c9bf55-4d98-4b58-9b63-87ff4d3b7029 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:10.569185 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-05c9bf55-4d98-4b58-9b63-87ff4d3b7029 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:10.582289 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-05c9bf55-4d98-4b58-9b63-87ff4d3b7029 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] HTTP exception thrown: Instance eb6aeebb-bf67-4347-bd45-ea06175e8939 could not be found. Jun 16 00:37:10.583899 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-05c9bf55-4d98-4b58-9b63-87ff4d3b7029 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Request method failure captured: Jun 16 00:37:10.583899 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: DELETE /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939 HTTP/1.1 Jun 16 00:37:10.583899 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:37:10.583899 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:37:10.583899 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:37:10.583899 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:37:10.583899 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:37:10.583899 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:37:10.583899 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:37:10.583899 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:37:10.583899 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnoohqT51d1Og861drBVM1xT3p_YO-9Ywiwgdfnk41ZHtqwaCkHblNwVf0CcDS17ycAX4Q7GuugzikdHEKZC3dJA4z2IEyNcGKiMAYGoC7Gn6zonVVDjLc6O2cmS2ChJDYIUrCysOkv-f1SqjTvRN_64xm0mUUK9wpDNigH52-7iWLo Jun 16 00:37:10.583899 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:37:10.583899 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:37:10.583899 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:37:10.583899 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:37:10.583899 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:37:10.583899 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:37:10.583899 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: d2cc2e1e741d4eeb849e07d9f2c371be Jun 16 00:37:10.583899 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-AttachVolumeTestJSON-174631568 Jun 16 00:37:10.583899 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:37:10.583899 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:37:10.585343 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:37:10.585343 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-AttachVolumeTestJSON-174631568 Jun 16 00:37:10.585343 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: d2cc2e1e741d4eeb849e07d9f2c371be Jun 16 00:37:10.585343 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-AttachVolumeTestJSON-174631568 Jun 16 00:37:10.585343 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-AttachVolumeTestJSON-174631568-project Jun 16 00:37:10.585343 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:37:10.585343 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:37:10.585343 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: d5985474b0774d8ea0e62718de767310 Jun 16 00:37:10.585343 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-AttachVolumeTestJSON-174631568-project Jun 16 00:37:10.585343 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:37:10.585343 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Instance eb6aeebb-bf67-4347-bd45-ea06175e8939 could not be found. Jun 16 00:37:10.585343 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': 'eb6aeebb-bf67-4347-bd45-ea06175e8939'} Jun 16 00:37:10.586094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:37:10.586094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:10.586094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:37:10.586094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:37:10.586094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:37:10.586094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:37:10.586094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:37:10.586094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:37:10.586094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:37:10.586094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:37:10.586094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6aeebb-bf67-4347-bd45-ea06175e8939 could not be found. Jun 16 00:37:10.586094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:10.586094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:10.586094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:10.586094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:10.586094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:10.586094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:10.586094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:37:10.586094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:37:10.586094 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:37:10.587540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:37:10.587540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:37:10.587540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:37:10.587540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:37:10.587540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:37:10.587540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:37:10.587540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:37:10.587540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:37:10.587540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:37:10.587540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6aeebb-bf67-4347-bd45-ea06175e8939 could not be found. Jun 16 00:37:10.587540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:10.587540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:10.587540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:10.587540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:10.587540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:10.587540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:10.587540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:37:10.587540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:37:10.587540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6aeebb-bf67-4347-bd45-ea06175e8939 could not be found. Jun 16 00:37:10.587540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:10.589317 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-05c9bf55-4d98-4b58-9b63-87ff4d3b7029 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Returning 404 to user: Instance eb6aeebb-bf67-4347-bd45-ea06175e8939 could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:37:10.589317 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-05c9bf55-4d98-4b58-9b63-87ff4d3b7029 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "DELETE /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939" status: 404 len: 111 microversion: 2.1 time: 0.029537 Jun 16 00:37:10.589317 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 483/949] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:37:10 2022] DELETE /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:37:10.594065 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-35cf138d-8cbb-4e6e-8952-291f0eb28419 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:10.594738 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-35cf138d-8cbb-4e6e-8952-291f0eb28419 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: eb6aeebb-bf67-4347-bd45-ea06175e8939] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:10.601074 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-35cf138d-8cbb-4e6e-8952-291f0eb28419 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:10.601519 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-35cf138d-8cbb-4e6e-8952-291f0eb28419 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:10.602269 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-35cf138d-8cbb-4e6e-8952-291f0eb28419 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:10.602722 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-35cf138d-8cbb-4e6e-8952-291f0eb28419 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:10.617828 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-35cf138d-8cbb-4e6e-8952-291f0eb28419 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] HTTP exception thrown: Instance eb6aeebb-bf67-4347-bd45-ea06175e8939 could not be found. Jun 16 00:37:10.619490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-35cf138d-8cbb-4e6e-8952-291f0eb28419 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Request method failure captured: Jun 16 00:37:10.619490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939 HTTP/1.1 Jun 16 00:37:10.619490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:37:10.619490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:37:10.619490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:37:10.619490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:37:10.619490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:37:10.619490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:37:10.619490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:37:10.619490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:37:10.619490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnoohqT51d1Og861drBVM1xT3p_YO-9Ywiwgdfnk41ZHtqwaCkHblNwVf0CcDS17ycAX4Q7GuugzikdHEKZC3dJA4z2IEyNcGKiMAYGoC7Gn6zonVVDjLc6O2cmS2ChJDYIUrCysOkv-f1SqjTvRN_64xm0mUUK9wpDNigH52-7iWLo Jun 16 00:37:10.619490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:37:10.619490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:37:10.619490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:37:10.619490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:37:10.619490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:37:10.619490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:37:10.619490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: d2cc2e1e741d4eeb849e07d9f2c371be Jun 16 00:37:10.619490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-AttachVolumeTestJSON-174631568 Jun 16 00:37:10.619490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:37:10.619490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:37:10.621240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:37:10.621240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-AttachVolumeTestJSON-174631568 Jun 16 00:37:10.621240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: d2cc2e1e741d4eeb849e07d9f2c371be Jun 16 00:37:10.621240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-AttachVolumeTestJSON-174631568 Jun 16 00:37:10.621240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-AttachVolumeTestJSON-174631568-project Jun 16 00:37:10.621240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:37:10.621240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:37:10.621240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: d5985474b0774d8ea0e62718de767310 Jun 16 00:37:10.621240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-AttachVolumeTestJSON-174631568-project Jun 16 00:37:10.621240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: > Jun 16 00:37:10.621240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Instance eb6aeebb-bf67-4347-bd45-ea06175e8939 could not be found. Jun 16 00:37:10.621240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'id': 'eb6aeebb-bf67-4347-bd45-ea06175e8939'} Jun 16 00:37:10.622214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:37:10.622214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:10.622214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:37:10.622214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:37:10.622214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:37:10.622214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:37:10.622214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:37:10.622214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:37:10.622214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:37:10.622214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:37:10.622214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6aeebb-bf67-4347-bd45-ea06175e8939 could not be found. Jun 16 00:37:10.622214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:10.622214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:10.622214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:10.622214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:10.622214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:10.622214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:10.622214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:37:10.622214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:37:10.622214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:37:10.623962 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:37:10.623962 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:37:10.623962 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:37:10.623962 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:37:10.623962 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:37:10.623962 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:37:10.623962 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:37:10.623962 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6aeebb-bf67-4347-bd45-ea06175e8939 could not be found. Jun 16 00:37:10.623962 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:10.623962 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:10.623962 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:10.623962 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:10.623962 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:10.623962 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:10.623962 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:37:10.623962 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:37:10.623962 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6aeebb-bf67-4347-bd45-ea06175e8939 could not be found. Jun 16 00:37:10.623962 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:10.625461 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-35cf138d-8cbb-4e6e-8952-291f0eb28419 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Returning 404 to user: Instance eb6aeebb-bf67-4347-bd45-ea06175e8939 could not be found. {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:37:10.625461 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-35cf138d-8cbb-4e6e-8952-291f0eb28419 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939" status: 404 len: 111 microversion: 2.1 time: 0.031182 Jun 16 00:37:10.625461 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 467/950] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:10 2022] GET /compute/v2.1/servers/eb6aeebb-bf67-4347-bd45-ea06175e8939 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:37:11.100512 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d0b5f62b-8abd-4fb9-be00-c2cd722b2315 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:11.101143 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-d0b5f62b-8abd-4fb9-be00-c2cd722b2315 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] [instance: 7c40332e-ae77-4288-a12f-bf5719613917] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:11.107708 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d0b5f62b-8abd-4fb9-be00-c2cd722b2315 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:11.108152 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d0b5f62b-8abd-4fb9-be00-c2cd722b2315 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:11.108977 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d0b5f62b-8abd-4fb9-be00-c2cd722b2315 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:11.109410 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d0b5f62b-8abd-4fb9-be00-c2cd722b2315 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:11.122847 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-d0b5f62b-8abd-4fb9-be00-c2cd722b2315 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] HTTP exception thrown: Instance 7c40332e-ae77-4288-a12f-bf5719613917 could not be found. Jun 16 00:37:11.124447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d0b5f62b-8abd-4fb9-be00-c2cd722b2315 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Request method failure captured: Jun 16 00:37:11.124447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917 HTTP/1.1 Jun 16 00:37:11.124447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:37:11.124447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:37:11.124447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:37:11.124447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:37:11.124447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:37:11.124447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:37:11.124447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:37:11.124447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:37:11.124447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnrVSL7_TdS6otJPo5AgErN_O2oEoCLXAZbhC61hr-qjAuqbEz7JuxDN0SIRwy_mqQWgDViO-EDwcHyVfsmi2drA1v987xEyMWabTMphYMvejPVqv_OBlUoZn3OCzn6V1LdfBnOxWbVIBFi491Y3bP7VZfS8l2XUIevbMyIQJ-RLgG8 Jun 16 00:37:11.124447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:37:11.124447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:37:11.124447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:37:11.124447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:37:11.124447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:37:11.124447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:37:11.124447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: 8dd0505146da40efbb028199390f8c75 Jun 16 00:37:11.124447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1108582580 Jun 16 00:37:11.124447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:37:11.124447 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:37:11.126087 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8dd0505146da40efbb028199390f8c75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8dd0505146da40efbb028199390f8c75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8dd0505146da40efbb028199390f8c75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8dd0505146da40efbb028199390f8c75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:37:11.126087 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-VolumesSnapshotTestJSON-1108582580 Jun 16 00:37:11.126087 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: 8dd0505146da40efbb028199390f8c75 Jun 16 00:37:11.126087 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1108582580 Jun 16 00:37:11.126087 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-VolumesSnapshotTestJSON-1108582580-project Jun 16 00:37:11.126087 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:37:11.126087 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:37:11.126087 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: f77cfd6c2be6487e9701e08340c6c792 Jun 16 00:37:11.126087 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-VolumesSnapshotTestJSON-1108582580-project Jun 16 00:37:11.126087 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:37:11.126087 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Instance 7c40332e-ae77-4288-a12f-bf5719613917 could not be found. Jun 16 00:37:11.126087 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': '7c40332e-ae77-4288-a12f-bf5719613917'} Jun 16 00:37:11.127022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:37:11.127022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:11.127022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:37:11.127022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:37:11.127022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:37:11.127022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:37:11.127022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:37:11.127022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:37:11.127022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:37:11.127022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:37:11.127022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c40332e-ae77-4288-a12f-bf5719613917 could not be found. Jun 16 00:37:11.127022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:11.127022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:11.127022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:11.127022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:11.127022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:11.127022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:11.127022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:37:11.127022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:37:11.127022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:37:11.129797 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:37:11.129797 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:37:11.129797 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:37:11.129797 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:37:11.129797 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:37:11.129797 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:37:11.129797 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:37:11.129797 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c40332e-ae77-4288-a12f-bf5719613917 could not be found. Jun 16 00:37:11.129797 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:11.129797 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:11.129797 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:11.129797 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:11.129797 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:11.129797 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:11.129797 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:37:11.129797 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:37:11.129797 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c40332e-ae77-4288-a12f-bf5719613917 could not be found. Jun 16 00:37:11.129797 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:11.131136 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d0b5f62b-8abd-4fb9-be00-c2cd722b2315 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] Returning 404 to user: Instance 7c40332e-ae77-4288-a12f-bf5719613917 could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:37:11.131136 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-d0b5f62b-8abd-4fb9-be00-c2cd722b2315 tempest-VolumesSnapshotTestJSON-1108582580 tempest-VolumesSnapshotTestJSON-1108582580-project] 10.222.0.23 "GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917" status: 404 len: 111 microversion: 2.1 time: 0.029277 Jun 16 00:37:11.131136 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 484/951] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:11 2022] GET /compute/v2.1/servers/7c40332e-ae77-4288-a12f-bf5719613917 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:37:11.755292 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-227650ab-64fe-46a9-95b2-2d610b9b8ae7 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:11.755793 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-227650ab-64fe-46a9-95b2-2d610b9b8ae7 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:11.762360 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-227650ab-64fe-46a9-95b2-2d610b9b8ae7 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:11.762810 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-227650ab-64fe-46a9-95b2-2d610b9b8ae7 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:11.763828 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-227650ab-64fe-46a9-95b2-2d610b9b8ae7 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:11.764258 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-227650ab-64fe-46a9-95b2-2d610b9b8ae7 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:11.780404 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-227650ab-64fe-46a9-95b2-2d610b9b8ae7 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] HTTP exception thrown: Instance 9fb9a660-6782-42cf-81df-8ac25aa4873d could not be found. Jun 16 00:37:11.782481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-227650ab-64fe-46a9-95b2-2d610b9b8ae7 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Request method failure captured: Jun 16 00:37:11.782481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: DELETE /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d HTTP/1.1 Jun 16 00:37:11.782481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:37:11.782481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:37:11.782481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:37:11.782481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:37:11.782481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:37:11.782481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:37:11.782481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:37:11.782481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:37:11.782481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnoohqT51d1Og861drBVM1xT3p_YO-9Ywiwgdfnk41ZHtqwaCkHblNwVf0CcDS17ycAX4Q7GuugzikdHEKZC3dJA4z2IEyNcGKiMAYGoC7Gn6zonVVDjLc6O2cmS2ChJDYIUrCysOkv-f1SqjTvRN_64xm0mUUK9wpDNigH52-7iWLo Jun 16 00:37:11.782481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:37:11.782481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:37:11.782481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:37:11.782481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:37:11.782481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:37:11.782481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:37:11.782481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: d2cc2e1e741d4eeb849e07d9f2c371be Jun 16 00:37:11.782481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-AttachVolumeTestJSON-174631568 Jun 16 00:37:11.782481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:37:11.782481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:37:11.784128 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:37:11.784128 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-AttachVolumeTestJSON-174631568 Jun 16 00:37:11.784128 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: d2cc2e1e741d4eeb849e07d9f2c371be Jun 16 00:37:11.784128 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-AttachVolumeTestJSON-174631568 Jun 16 00:37:11.784128 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-AttachVolumeTestJSON-174631568-project Jun 16 00:37:11.784128 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:37:11.784128 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:37:11.784128 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: d5985474b0774d8ea0e62718de767310 Jun 16 00:37:11.784128 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-AttachVolumeTestJSON-174631568-project Jun 16 00:37:11.784128 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: > Jun 16 00:37:11.784128 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Instance 9fb9a660-6782-42cf-81df-8ac25aa4873d could not be found. Jun 16 00:37:11.784128 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'id': '9fb9a660-6782-42cf-81df-8ac25aa4873d'} Jun 16 00:37:11.785282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:37:11.785282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:11.785282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:37:11.785282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:37:11.785282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:37:11.785282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:37:11.785282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:37:11.785282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:37:11.785282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:37:11.785282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:37:11.785282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fb9a660-6782-42cf-81df-8ac25aa4873d could not be found. Jun 16 00:37:11.785282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:11.785282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:11.785282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:11.785282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:11.785282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:11.785282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:11.785282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:37:11.785282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:37:11.785282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:37:11.786747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:37:11.786747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:37:11.786747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:37:11.786747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:37:11.786747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:37:11.786747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:37:11.786747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:37:11.786747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:37:11.786747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:37:11.786747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fb9a660-6782-42cf-81df-8ac25aa4873d could not be found. Jun 16 00:37:11.786747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:11.786747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:11.786747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:11.786747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:11.786747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:11.786747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:11.786747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:37:11.786747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:37:11.786747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fb9a660-6782-42cf-81df-8ac25aa4873d could not be found. Jun 16 00:37:11.786747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:11.788339 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-227650ab-64fe-46a9-95b2-2d610b9b8ae7 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Returning 404 to user: Instance 9fb9a660-6782-42cf-81df-8ac25aa4873d could not be found. {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:37:11.788339 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-227650ab-64fe-46a9-95b2-2d610b9b8ae7 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 404 len: 111 microversion: 2.1 time: 0.032433 Jun 16 00:37:11.788339 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 468/952] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:37:11 2022] DELETE /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:37:11.792197 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-fabf9ebd-d6bb-4bdd-be26-06b43a1ebe52 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:11.792806 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-fabf9ebd-d6bb-4bdd-be26-06b43a1ebe52 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] [instance: 9fb9a660-6782-42cf-81df-8ac25aa4873d] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:11.799704 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fabf9ebd-d6bb-4bdd-be26-06b43a1ebe52 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:11.800149 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fabf9ebd-d6bb-4bdd-be26-06b43a1ebe52 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:11.800933 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fabf9ebd-d6bb-4bdd-be26-06b43a1ebe52 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:11.801365 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fabf9ebd-d6bb-4bdd-be26-06b43a1ebe52 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:11.815432 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-fabf9ebd-d6bb-4bdd-be26-06b43a1ebe52 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] HTTP exception thrown: Instance 9fb9a660-6782-42cf-81df-8ac25aa4873d could not be found. Jun 16 00:37:11.816971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-fabf9ebd-d6bb-4bdd-be26-06b43a1ebe52 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Request method failure captured: Jun 16 00:37:11.816971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d HTTP/1.1 Jun 16 00:37:11.816971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:37:11.816971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:37:11.816971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:37:11.816971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:37:11.816971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:37:11.816971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:37:11.816971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:37:11.816971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:37:11.816971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnoohqT51d1Og861drBVM1xT3p_YO-9Ywiwgdfnk41ZHtqwaCkHblNwVf0CcDS17ycAX4Q7GuugzikdHEKZC3dJA4z2IEyNcGKiMAYGoC7Gn6zonVVDjLc6O2cmS2ChJDYIUrCysOkv-f1SqjTvRN_64xm0mUUK9wpDNigH52-7iWLo Jun 16 00:37:11.816971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:37:11.816971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:37:11.816971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:37:11.816971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:37:11.816971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:37:11.816971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:37:11.816971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: d2cc2e1e741d4eeb849e07d9f2c371be Jun 16 00:37:11.816971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-AttachVolumeTestJSON-174631568 Jun 16 00:37:11.816971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:37:11.816971 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:37:11.818536 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d2cc2e1e741d4eeb849e07d9f2c371be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:37:11.818536 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-AttachVolumeTestJSON-174631568 Jun 16 00:37:11.818536 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: d2cc2e1e741d4eeb849e07d9f2c371be Jun 16 00:37:11.818536 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-AttachVolumeTestJSON-174631568 Jun 16 00:37:11.818536 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-AttachVolumeTestJSON-174631568-project Jun 16 00:37:11.818536 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:37:11.818536 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:37:11.818536 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: d5985474b0774d8ea0e62718de767310 Jun 16 00:37:11.818536 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-AttachVolumeTestJSON-174631568-project Jun 16 00:37:11.818536 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:37:11.818536 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Instance 9fb9a660-6782-42cf-81df-8ac25aa4873d could not be found. Jun 16 00:37:11.818536 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': '9fb9a660-6782-42cf-81df-8ac25aa4873d'} Jun 16 00:37:11.819541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:37:11.819541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:11.819541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:37:11.819541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:37:11.819541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:37:11.819541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:37:11.819541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:37:11.819541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:37:11.819541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:37:11.819541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:37:11.819541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fb9a660-6782-42cf-81df-8ac25aa4873d could not be found. Jun 16 00:37:11.819541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:11.819541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:11.819541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:11.819541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:11.819541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:11.819541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:11.819541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:37:11.819541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:37:11.819541 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:37:11.821007 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:37:11.821007 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:37:11.821007 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:37:11.821007 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:37:11.821007 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:37:11.821007 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:37:11.821007 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:37:11.821007 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fb9a660-6782-42cf-81df-8ac25aa4873d could not be found. Jun 16 00:37:11.821007 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:11.821007 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:11.821007 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:11.821007 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:11.821007 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:11.821007 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:11.821007 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:37:11.821007 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:37:11.821007 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fb9a660-6782-42cf-81df-8ac25aa4873d could not be found. Jun 16 00:37:11.821007 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:11.822461 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-fabf9ebd-d6bb-4bdd-be26-06b43a1ebe52 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] Returning 404 to user: Instance 9fb9a660-6782-42cf-81df-8ac25aa4873d could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:37:11.822461 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-fabf9ebd-d6bb-4bdd-be26-06b43a1ebe52 tempest-AttachVolumeTestJSON-174631568 tempest-AttachVolumeTestJSON-174631568-project] 10.222.0.23 "GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d" status: 404 len: 111 microversion: 2.1 time: 0.029964 Jun 16 00:37:11.822461 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 485/953] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:11 2022] GET /compute/v2.1/servers/9fb9a660-6782-42cf-81df-8ac25aa4873d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:37:16.385718 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-131468f1-c237-408a-aee8-4b662071d8aa tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] Action: 'create', calling method: .version_select at 0x7fe704a639d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-373016301", "metadata": {"Type": "work"}}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:37:16.406156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-131468f1-c237-408a-aee8-4b662071d8aa tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] Request method failure captured: Jun 16 00:37:16.406156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 00:37:16.406156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:37:16.406156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:37:16.406156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:37:16.406156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 121 Jun 16 00:37:16.406156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:37:16.406156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:37:16.406156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:37:16.406156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:37:16.406156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqns8YSPWWdbVxb19X1Cf8cqfYSYCifskmsq97eG454x__0_LJbk9i3b420gKx1niJdFUgK40nB8tmd8Y0AQNRqJk7X3mDPdW58HEgCJGCyn9Eemr62Kow7fpMrAqONryn8fuTGs1hjy-lxhp9sXjFH7mk3ni7WoFtFOA1rw5Ak3m7kQ Jun 16 00:37:16.406156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:37:16.406156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:37:16.406156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:37:16.406156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:37:16.406156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:37:16.406156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:37:16.406156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: d8cc73c7367441769406ab11e9d308a6 Jun 16 00:37:16.406156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-VolumesNegativeTest-629039462 Jun 16 00:37:16.406156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:37:16.406156 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:37:16.407975 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:37:16.407975 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-VolumesNegativeTest-629039462 Jun 16 00:37:16.407975 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: d8cc73c7367441769406ab11e9d308a6 Jun 16 00:37:16.407975 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-VolumesNegativeTest-629039462 Jun 16 00:37:16.407975 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-VolumesNegativeTest-629039462-project Jun 16 00:37:16.407975 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:37:16.407975 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:37:16.407975 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: c830b04dc5c34067bd49a94b99d5c259 Jun 16 00:37:16.407975 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-VolumesNegativeTest-629039462-project Jun 16 00:37:16.407975 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Jun 16 00:37:16.407975 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-373016301", "metadata": {"Type": "work"}}} Jun 16 00:37:16.407975 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: Jun 16 00:37:16.407975 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 00:37:16.409005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-373016301', 'metadata': {'Type': 'work'}}}} Jun 16 00:37:16.409005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:37:16.409005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:16.409005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 00:37:16.409005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 00:37:16.409005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 00:37:16.409005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise error Jun 16 00:37:16.409005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 16 00:37:16.409005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.409005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 00:37:16.409005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 00:37:16.409005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.409005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 00:37:16.409005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi '#$%' Jun 16 00:37:16.409005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.409005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:16.409005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.409005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:16.409005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:16.409005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:16.409005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:37:16.409005 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:37:16.410755 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:37:16.410755 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:37:16.410755 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:37:16.410755 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:37:16.410755 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 00:37:16.410755 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 00:37:16.410755 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 00:37:16.410755 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 00:37:16.410755 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 00:37:16.410755 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 00:37:16.410755 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 00:37:16.410755 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.410755 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:16.410755 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.410755 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:16.410755 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:16.410755 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:16.410755 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 00:37:16.410755 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 00:37:16.412203 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 00:37:16.412203 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.412203 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-131468f1-c237-408a-aee8-4b662071d8aa tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:37:16.412203 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-131468f1-c237-408a-aee8-4b662071d8aa tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.137588 Jun 16 00:37:16.414802 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 469/954] 10.222.0.23 () {60 vars in 1155 bytes} [Thu Jun 16 00:37:16 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:37:16.418278 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-aca5f5d5-8d5b-40bb-a9a2-e90548690621 tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] Action: 'create', calling method: .version_select at 0x7fe704a1a820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1107894538", "metadata": {"Type": "work"}}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:37:16.422569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-aca5f5d5-8d5b-40bb-a9a2-e90548690621 tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] Request method failure captured: Jun 16 00:37:16.422569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 00:37:16.422569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:37:16.422569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:37:16.422569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:37:16.422569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 120 Jun 16 00:37:16.422569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:37:16.422569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:37:16.422569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:37:16.422569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:37:16.422569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqns8YSPWWdbVxb19X1Cf8cqfYSYCifskmsq97eG454x__0_LJbk9i3b420gKx1niJdFUgK40nB8tmd8Y0AQNRqJk7X3mDPdW58HEgCJGCyn9Eemr62Kow7fpMrAqONryn8fuTGs1hjy-lxhp9sXjFH7mk3ni7WoFtFOA1rw5Ak3m7kQ Jun 16 00:37:16.422569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:37:16.422569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:37:16.422569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:37:16.422569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:37:16.422569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:37:16.422569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:37:16.422569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: d8cc73c7367441769406ab11e9d308a6 Jun 16 00:37:16.422569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-VolumesNegativeTest-629039462 Jun 16 00:37:16.422569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:37:16.422569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:37:16.424458 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:37:16.424458 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-VolumesNegativeTest-629039462 Jun 16 00:37:16.424458 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: d8cc73c7367441769406ab11e9d308a6 Jun 16 00:37:16.424458 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-VolumesNegativeTest-629039462 Jun 16 00:37:16.424458 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-VolumesNegativeTest-629039462-project Jun 16 00:37:16.424458 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:37:16.424458 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:37:16.424458 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: c830b04dc5c34067bd49a94b99d5c259 Jun 16 00:37:16.424458 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-VolumesNegativeTest-629039462-project Jun 16 00:37:16.424458 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Jun 16 00:37:16.424458 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1107894538", "metadata": {"Type": "work"}}} Jun 16 00:37:16.424458 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: Jun 16 00:37:16.424458 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 00:37:16.425482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1107894538', 'metadata': {'Type': 'work'}}}} Jun 16 00:37:16.425482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:37:16.425482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:16.425482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 00:37:16.425482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 00:37:16.425482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 00:37:16.425482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise error Jun 16 00:37:16.425482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 16 00:37:16.425482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.425482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 16 00:37:16.425482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 00:37:16.425482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.425482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 00:37:16.425482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi '0' Jun 16 00:37:16.425482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.425482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:16.425482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.425482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:16.425482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:16.425482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:16.425482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:37:16.425482 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:37:16.427543 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:37:16.427543 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:37:16.427543 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:37:16.427543 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:37:16.427543 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 00:37:16.427543 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 00:37:16.427543 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 00:37:16.427543 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 00:37:16.427543 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 00:37:16.427543 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 00:37:16.427543 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 00:37:16.427543 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.427543 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:16.427543 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.427543 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:16.427543 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:16.427543 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:16.427543 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 00:37:16.427543 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 00:37:16.429130 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 00:37:16.429130 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.429130 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-aca5f5d5-8d5b-40bb-a9a2-e90548690621 tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:37:16.429130 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-aca5f5d5-8d5b-40bb-a9a2-e90548690621 tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009865 Jun 16 00:37:16.429130 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 486/955] 10.222.0.23 () {60 vars in 1155 bytes} [Thu Jun 16 00:37:16 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 00:37:16.434294 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-18426af1-4319-468b-b2e1-6470f6f153bb tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] Action: 'create', calling method: .version_select at 0x7fe704937c10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1210081746", "metadata": {"Type": "work"}}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:37:16.437409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-18426af1-4319-468b-b2e1-6470f6f153bb tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] Request method failure captured: Jun 16 00:37:16.437409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 00:37:16.437409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:37:16.437409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:37:16.437409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:37:16.437409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 119 Jun 16 00:37:16.437409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:37:16.437409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:37:16.437409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:37:16.437409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:37:16.437409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqns8YSPWWdbVxb19X1Cf8cqfYSYCifskmsq97eG454x__0_LJbk9i3b420gKx1niJdFUgK40nB8tmd8Y0AQNRqJk7X3mDPdW58HEgCJGCyn9Eemr62Kow7fpMrAqONryn8fuTGs1hjy-lxhp9sXjFH7mk3ni7WoFtFOA1rw5Ak3m7kQ Jun 16 00:37:16.437409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:37:16.437409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:37:16.437409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:37:16.437409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:37:16.437409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:37:16.437409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:37:16.437409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: d8cc73c7367441769406ab11e9d308a6 Jun 16 00:37:16.437409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-VolumesNegativeTest-629039462 Jun 16 00:37:16.437409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:37:16.437409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:37:16.439237 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:37:16.439237 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-VolumesNegativeTest-629039462 Jun 16 00:37:16.439237 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: d8cc73c7367441769406ab11e9d308a6 Jun 16 00:37:16.439237 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-VolumesNegativeTest-629039462 Jun 16 00:37:16.439237 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-VolumesNegativeTest-629039462-project Jun 16 00:37:16.439237 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:37:16.439237 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:37:16.439237 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: c830b04dc5c34067bd49a94b99d5c259 Jun 16 00:37:16.439237 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-VolumesNegativeTest-629039462-project Jun 16 00:37:16.439237 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Jun 16 00:37:16.439237 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1210081746", "metadata": {"Type": "work"}}} Jun 16 00:37:16.439237 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: Jun 16 00:37:16.439237 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 00:37:16.440191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1210081746', 'metadata': {'Type': 'work'}}}} Jun 16 00:37:16.440191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:37:16.440191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:16.440191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 00:37:16.440191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 00:37:16.440191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 00:37:16.440191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise error Jun 16 00:37:16.440191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 16 00:37:16.440191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.440191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 00:37:16.440191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 00:37:16.440191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.440191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 00:37:16.440191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi '' Jun 16 00:37:16.440191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.440191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:16.440191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.440191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:16.440191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:16.440191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:16.440191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:37:16.440191 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:37:16.441582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:37:16.441582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:37:16.441582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:37:16.441582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:37:16.441582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 00:37:16.441582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 00:37:16.441582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 00:37:16.441582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 00:37:16.441582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 00:37:16.441582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 00:37:16.441582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 00:37:16.441582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.441582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:16.441582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.441582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:16.441582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:16.441582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:16.441582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 00:37:16.441582 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 00:37:16.442706 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 00:37:16.442706 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.442706 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-18426af1-4319-468b-b2e1-6470f6f153bb tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:37:16.442706 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-18426af1-4319-468b-b2e1-6470f6f153bb tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008493 Jun 16 00:37:16.442706 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 470/956] 10.222.0.23 () {60 vars in 1155 bytes} [Thu Jun 16 00:37:16 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:37:16.449018 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-75cd3e3a-3825-43bc-abd4-0d65f690ec0e tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] Calling method '.version_select at 0x7fe704a96a60>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:16.479367 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-75cd3e3a-3825-43bc-abd4-0d65f690ec0e tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] HTTP exception thrown: Volume tempest-invalid-1341064633 could not be found. Jun 16 00:37:16.481416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-75cd3e3a-3825-43bc-abd4-0d65f690ec0e tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] Request method failure captured: Jun 16 00:37:16.481416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1341064633 HTTP/1.1 Jun 16 00:37:16.481416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:37:16.481416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:37:16.481416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:37:16.481416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:37:16.481416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:37:16.481416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:37:16.481416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:37:16.481416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:37:16.481416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqns8YSPWWdbVxb19X1Cf8cqfYSYCifskmsq97eG454x__0_LJbk9i3b420gKx1niJdFUgK40nB8tmd8Y0AQNRqJk7X3mDPdW58HEgCJGCyn9Eemr62Kow7fpMrAqONryn8fuTGs1hjy-lxhp9sXjFH7mk3ni7WoFtFOA1rw5Ak3m7kQ Jun 16 00:37:16.481416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:37:16.481416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:37:16.481416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:37:16.481416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:37:16.481416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:37:16.481416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:37:16.481416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: d8cc73c7367441769406ab11e9d308a6 Jun 16 00:37:16.481416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-VolumesNegativeTest-629039462 Jun 16 00:37:16.481416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:37:16.481416 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:37:16.482902 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:37:16.482902 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-VolumesNegativeTest-629039462 Jun 16 00:37:16.482902 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: d8cc73c7367441769406ab11e9d308a6 Jun 16 00:37:16.482902 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-VolumesNegativeTest-629039462 Jun 16 00:37:16.482902 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-VolumesNegativeTest-629039462-project Jun 16 00:37:16.482902 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:37:16.482902 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:37:16.482902 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: c830b04dc5c34067bd49a94b99d5c259 Jun 16 00:37:16.482902 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-VolumesNegativeTest-629039462-project Jun 16 00:37:16.482902 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: Jun 16 00:37:16.482902 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Volume tempest-invalid-1341064633 could not be found. Jun 16 00:37:16.482902 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': 'tempest-invalid-1341064633'} Jun 16 00:37:16.482902 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:37:16.483819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:16.483819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:37:16.483819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:37:16.483819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 00:37:16.483819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 00:37:16.483819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 00:37:16.483819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 00:37:16.483819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 00:37:16.483819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 00:37:16.483819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 00:37:16.483819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 00:37:16.483819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:37:16.483819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:37:16.483819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:37:16.483819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:37:16.483819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1341064633 could not be found. (HTTP 404) (Request-ID: req-ac100823-2308-4f75-880f-73510bec6c17) Jun 16 00:37:16.483819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.483819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:16.483819 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.485217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:16.485217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 00:37:16.485217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 00:37:16.485217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:37:16.485217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:37:16.485217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 00:37:16.485217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 00:37:16.485217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:37:16.485217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:37:16.485217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:37:16.485217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:37:16.485217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 00:37:16.485217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 00:37:16.485217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 00:37:16.485217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 00:37:16.485217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 00:37:16.485217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 00:37:16.485217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 00:37:16.485217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 00:37:16.486838 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:37:16.486838 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:37:16.486838 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:37:16.486838 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:37:16.486838 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1341064633 could not be found. Jun 16 00:37:16.486838 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.486838 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:16.486838 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.486838 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:16.486838 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:16.486838 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:16.486838 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:37:16.486838 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:37:16.486838 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:37:16.486838 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:37:16.486838 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:37:16.486838 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:37:16.486838 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 00:37:16.486838 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:37:16.486838 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1341064633 could not be found. Jun 16 00:37:16.488653 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.488653 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:16.488653 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.488653 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:16.488653 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:16.488653 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:16.488653 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:37:16.488653 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:37:16.488653 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1341064633 could not be found. Jun 16 00:37:16.488653 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.488653 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-75cd3e3a-3825-43bc-abd4-0d65f690ec0e tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] Returning 404 to user: Volume tempest-invalid-1341064633 could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:37:16.488653 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-75cd3e3a-3825-43bc-abd4-0d65f690ec0e tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1341064633" status: 404 len: 99 microversion: 2.1 time: 0.038163 Jun 16 00:37:16.488653 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 487/957] 10.222.0.23 () {58 vars in 1217 bytes} [Thu Jun 16 00:37:16 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1341064633 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 00:37:16.493924 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-17f8c262-9222-4492-b1b7-bee0f370b0d9 tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005019 Jun 16 00:37:16.494480 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 471/958] 10.222.0.23 () {58 vars in 1139 bytes} [Thu Jun 16 00:37:16 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 00:37:16.502956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-d72ae19c-ba73-4e45-83da-ab3c3b6a88d9 tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003876 Jun 16 00:37:16.503429 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 488/959] 10.222.0.23 () {58 vars in 1136 bytes} [Thu Jun 16 00:37:16 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 00:37:16.511421 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d509cf26-2564-4c81-b53f-43df9b3fee0a tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] Calling method '.version_select at 0x7fe704aa5a60>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:16.540269 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-d509cf26-2564-4c81-b53f-43df9b3fee0a tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] HTTP exception thrown: Volume b92e1a2d-9154-4217-afe3-f391ef9dece4 could not be found. Jun 16 00:37:16.542246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d509cf26-2564-4c81-b53f-43df9b3fee0a tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] Request method failure captured: Jun 16 00:37:16.542246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: DELETE /compute/v2.1/os-volumes/b92e1a2d-9154-4217-afe3-f391ef9dece4 HTTP/1.1 Jun 16 00:37:16.542246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:37:16.542246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:37:16.542246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:37:16.542246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:37:16.542246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:37:16.542246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:37:16.542246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:37:16.542246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:37:16.542246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqns8YSPWWdbVxb19X1Cf8cqfYSYCifskmsq97eG454x__0_LJbk9i3b420gKx1niJdFUgK40nB8tmd8Y0AQNRqJk7X3mDPdW58HEgCJGCyn9Eemr62Kow7fpMrAqONryn8fuTGs1hjy-lxhp9sXjFH7mk3ni7WoFtFOA1rw5Ak3m7kQ Jun 16 00:37:16.542246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:37:16.542246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:37:16.542246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:37:16.542246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:37:16.542246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:37:16.542246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:37:16.542246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: d8cc73c7367441769406ab11e9d308a6 Jun 16 00:37:16.542246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-VolumesNegativeTest-629039462 Jun 16 00:37:16.542246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:37:16.542246 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:37:16.543857 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:37:16.543857 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-VolumesNegativeTest-629039462 Jun 16 00:37:16.543857 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: d8cc73c7367441769406ab11e9d308a6 Jun 16 00:37:16.543857 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-VolumesNegativeTest-629039462 Jun 16 00:37:16.543857 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-VolumesNegativeTest-629039462-project Jun 16 00:37:16.543857 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:37:16.543857 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:37:16.543857 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: c830b04dc5c34067bd49a94b99d5c259 Jun 16 00:37:16.543857 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-VolumesNegativeTest-629039462-project Jun 16 00:37:16.543857 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: Jun 16 00:37:16.543857 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Volume b92e1a2d-9154-4217-afe3-f391ef9dece4 could not be found. Jun 16 00:37:16.543857 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'id': 'b92e1a2d-9154-4217-afe3-f391ef9dece4'} Jun 16 00:37:16.543857 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:37:16.549043 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:16.549043 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:37:16.549043 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:37:16.549043 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 00:37:16.549043 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 00:37:16.549043 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 00:37:16.549043 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 00:37:16.549043 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 00:37:16.549043 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 00:37:16.549043 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 00:37:16.549043 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 00:37:16.549043 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:37:16.549043 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:37:16.549043 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:37:16.549043 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:37:16.549043 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b92e1a2d-9154-4217-afe3-f391ef9dece4 could not be found. (HTTP 404) (Request-ID: req-6c63f1ba-4502-4c00-9875-9491ad6c5836) Jun 16 00:37:16.549043 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.549043 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:16.549043 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.550618 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:16.550618 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 00:37:16.550618 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 00:37:16.550618 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:37:16.550618 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:37:16.550618 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 00:37:16.550618 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 00:37:16.550618 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:37:16.550618 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:37:16.550618 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:37:16.550618 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:37:16.550618 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 00:37:16.550618 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 00:37:16.550618 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 00:37:16.550618 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 00:37:16.550618 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 00:37:16.550618 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 00:37:16.550618 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 00:37:16.550618 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 00:37:16.552132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:37:16.552132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:37:16.552132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:37:16.552132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:37:16.552132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b92e1a2d-9154-4217-afe3-f391ef9dece4 could not be found. Jun 16 00:37:16.552132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.552132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:16.552132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.552132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:16.552132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:16.552132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:16.552132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:37:16.552132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:37:16.552132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:37:16.552132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:37:16.552132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:37:16.552132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:37:16.552132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 00:37:16.552132 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:37:16.553663 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b92e1a2d-9154-4217-afe3-f391ef9dece4 could not be found. Jun 16 00:37:16.553663 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.553663 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:16.553663 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.553663 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:16.553663 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:16.553663 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:16.553663 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:37:16.553663 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:37:16.553663 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b92e1a2d-9154-4217-afe3-f391ef9dece4 could not be found. Jun 16 00:37:16.553663 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.553663 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d509cf26-2564-4c81-b53f-43df9b3fee0a tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] Returning 404 to user: Volume b92e1a2d-9154-4217-afe3-f391ef9dece4 could not be found. {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:37:16.553663 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d509cf26-2564-4c81-b53f-43df9b3fee0a tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/b92e1a2d-9154-4217-afe3-f391ef9dece4" status: 404 len: 109 microversion: 2.1 time: 0.035677 Jun 16 00:37:16.553663 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 472/960] 10.222.0.23 () {58 vars in 1247 bytes} [Thu Jun 16 00:37:16 2022] DELETE /compute/v2.1/os-volumes/b92e1a2d-9154-4217-afe3-f391ef9dece4 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 00:37:16.554760 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-2ef57614-2f5d-480e-80ed-aefa453da848 tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] Calling method '.version_select at 0x7fe7049605e0>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:16.583342 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-2ef57614-2f5d-480e-80ed-aefa453da848 tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] HTTP exception thrown: Volume 6b255405-9ac1-4665-86e3-85131a15bda2 could not be found. Jun 16 00:37:16.585301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-2ef57614-2f5d-480e-80ed-aefa453da848 tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] Request method failure captured: Jun 16 00:37:16.585301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: GET /compute/v2.1/os-volumes/6b255405-9ac1-4665-86e3-85131a15bda2 HTTP/1.1 Jun 16 00:37:16.585301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:37:16.585301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:37:16.585301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:37:16.585301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:37:16.585301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:37:16.585301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:37:16.585301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:37:16.585301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:37:16.585301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqns8YSPWWdbVxb19X1Cf8cqfYSYCifskmsq97eG454x__0_LJbk9i3b420gKx1niJdFUgK40nB8tmd8Y0AQNRqJk7X3mDPdW58HEgCJGCyn9Eemr62Kow7fpMrAqONryn8fuTGs1hjy-lxhp9sXjFH7mk3ni7WoFtFOA1rw5Ak3m7kQ Jun 16 00:37:16.585301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:37:16.585301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:37:16.585301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:37:16.585301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:37:16.585301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:37:16.585301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:37:16.585301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: d8cc73c7367441769406ab11e9d308a6 Jun 16 00:37:16.585301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-VolumesNegativeTest-629039462 Jun 16 00:37:16.585301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:37:16.585301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:37:16.586866 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8cc73c7367441769406ab11e9d308a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:37:16.586866 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-VolumesNegativeTest-629039462 Jun 16 00:37:16.586866 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: d8cc73c7367441769406ab11e9d308a6 Jun 16 00:37:16.586866 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-VolumesNegativeTest-629039462 Jun 16 00:37:16.586866 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-VolumesNegativeTest-629039462-project Jun 16 00:37:16.586866 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:37:16.586866 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:37:16.586866 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: c830b04dc5c34067bd49a94b99d5c259 Jun 16 00:37:16.586866 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-VolumesNegativeTest-629039462-project Jun 16 00:37:16.586866 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: Jun 16 00:37:16.586866 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Volume 6b255405-9ac1-4665-86e3-85131a15bda2 could not be found. Jun 16 00:37:16.586866 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': '6b255405-9ac1-4665-86e3-85131a15bda2'} Jun 16 00:37:16.586866 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:37:16.588216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:16.588216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:37:16.588216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:37:16.588216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:37:16.588216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:37:16.588216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:37:16.588216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:37:16.588216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:37:16.588216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:37:16.588216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:37:16.588216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:37:16.588216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:37:16.588216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:37:16.588216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:37:16.588216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:37:16.588216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6b255405-9ac1-4665-86e3-85131a15bda2 could not be found. (HTTP 404) (Request-ID: req-fbe0f69f-20c1-4a8a-826c-9c31cd588827) Jun 16 00:37:16.588216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.588216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:16.588216 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.590042 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:16.590042 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 00:37:16.590042 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 00:37:16.590042 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:37:16.590042 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:37:16.590042 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 00:37:16.590042 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 00:37:16.590042 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:37:16.590042 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:37:16.590042 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:37:16.590042 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:37:16.590042 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:37:16.590042 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:37:16.590042 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:37:16.590042 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:37:16.590042 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:37:16.590042 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:37:16.590042 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:37:16.590042 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:37:16.591690 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:37:16.591690 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:37:16.591690 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:37:16.591690 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:37:16.591690 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6b255405-9ac1-4665-86e3-85131a15bda2 could not be found. Jun 16 00:37:16.591690 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.591690 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:16.591690 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.591690 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:16.591690 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:16.591690 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:16.591690 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:37:16.591690 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:37:16.591690 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:37:16.591690 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:37:16.591690 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:37:16.591690 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:37:16.591690 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 00:37:16.591690 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:37:16.593908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6b255405-9ac1-4665-86e3-85131a15bda2 could not be found. Jun 16 00:37:16.593908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.593908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:16.593908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.593908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:16.593908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:16.593908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:16.593908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:37:16.593908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:37:16.593908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6b255405-9ac1-4665-86e3-85131a15bda2 could not be found. Jun 16 00:37:16.593908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:37:16.593908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-2ef57614-2f5d-480e-80ed-aefa453da848 tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] Returning 404 to user: Volume 6b255405-9ac1-4665-86e3-85131a15bda2 could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:37:16.593908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-2ef57614-2f5d-480e-80ed-aefa453da848 tempest-VolumesNegativeTest-629039462 tempest-VolumesNegativeTest-629039462-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/6b255405-9ac1-4665-86e3-85131a15bda2" status: 404 len: 109 microversion: 2.1 time: 0.037283 Jun 16 00:37:16.593908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 489/961] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Jun 16 00:37:16 2022] GET /compute/v2.1/os-volumes/6b255405-9ac1-4665-86e3-85131a15bda2 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:37:42.122311 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:42.124492 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:42.316519 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-27a76681-5c71-426c-840e-90a833bc4e69 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Action: 'create', calling method: .version_select at 0x7fe704937b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-950829016", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRkdTNVACx+wRzG6T4FD0HGrrD1SFwsuUMB4WOEKwfTFTLOI2pWkPdSZZzujdexSoR7BNOfIgMwB3dpB9HZ0QX1jc2luHugMcVg0szEnd2nR08maRWMIlS5VBtRWrSzbw=="}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:37:42.333636 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-27a76681-5c71-426c-840e-90a833bc4e69 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Getting quotas for project e831286870b24b39bc1f72f087bf970e. Resources: {'key_pairs'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:37:42.337880 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-27a76681-5c71-426c-840e-90a833bc4e69 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Getting quotas for user 218cff6f99a74a3f8e5cdd4e9787539d and project e831286870b24b39bc1f72f087bf970e. Resources: {'key_pairs'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:37:42.365530 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-27a76681-5c71-426c-840e-90a833bc4e69 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.244403 Jun 16 00:37:42.366886 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 473/962] 10.222.0.23 () {60 vars in 1158 bytes} [Thu Jun 16 00:37:42 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:37:59.573915 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:59.574683 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=60,nova_cell1:INSERT=2 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:59.579278 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d4bd76f7-46db-4d76-9217-5c3eb9ec6af2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-415860252", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-950829016", "security_groups": [{"name": "tempest-secgroup-smoke-1397546455"}], "networks": [{"uuid": "8f2ea4f6-4dbf-47f5-b7aa-47996fe1abce"}], "block_device_mapping_v2": [{"uuid": "7d6354d3-78df-4055-b541-ebc5a3079724", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:37:59.691370 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.network.neutron [None req-d4bd76f7-46db-4d76-9217-5c3eb9ec6af2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] validate_networks() for [('8f2ea4f6-4dbf-47f5-b7aa-47996fe1abce', None, None, None, None, None)] {{(pid=124231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:38:00.068820 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-d4bd76f7-46db-4d76-9217-5c3eb9ec6af2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Flavor limits 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:38:00.069284 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-d4bd76f7-46db-4d76-9217-5c3eb9ec6af2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Image limits 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:38:00.069748 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-d4bd76f7-46db-4d76-9217-5c3eb9ec6af2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Flavor pref 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:38:00.070149 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-d4bd76f7-46db-4d76-9217-5c3eb9ec6af2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Image pref 0:0:0 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:38:00.070580 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.virt.hardware [None req-d4bd76f7-46db-4d76-9217-5c3eb9ec6af2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:38:00.079904 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d4bd76f7-46db-4d76-9217-5c3eb9ec6af2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:00.080349 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d4bd76f7-46db-4d76-9217-5c3eb9ec6af2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:00.081169 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d4bd76f7-46db-4d76-9217-5c3eb9ec6af2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:00.081605 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d4bd76f7-46db-4d76-9217-5c3eb9ec6af2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:00.101271 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-d4bd76f7-46db-4d76-9217-5c3eb9ec6af2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Getting quotas for project e831286870b24b39bc1f72f087bf970e. Resources: {'ram', 'cores', 'instances'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:38:00.105166 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.quota [None req-d4bd76f7-46db-4d76-9217-5c3eb9ec6af2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Getting quotas for user 218cff6f99a74a3f8e5cdd4e9787539d and project e831286870b24b39bc1f72f087bf970e. Resources: {'ram', 'cores', 'instances'} {{(pid=124231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:38:00.172938 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-d4bd76f7-46db-4d76-9217-5c3eb9ec6af2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Going to run 1 instances... {{(pid=124231) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:38:00.175043 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-d4bd76f7-46db-4d76-9217-5c3eb9ec6af2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d6354d3-78df-4055-b541-ebc5a3079724',volume_size=None,volume_type=None)] {{(pid=124231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:38:00.301864 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-d4bd76f7-46db-4d76-9217-5c3eb9ec6af2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.730186 Jun 16 00:38:00.302491 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 490/963] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Jun 16 00:37:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:38:00.309958 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=4 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:00.310798 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:00.315335 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-6f19415e-5c4c-4cdf-911a-990ad302ddf7 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:00.315944 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-6f19415e-5c4c-4cdf-911a-990ad302ddf7 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:00.371425 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-6f19415e-5c4c-4cdf-911a-990ad302ddf7 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:00.378592 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-6f19415e-5c4c-4cdf-911a-990ad302ddf7 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1087 microversion: 2.1 time: 0.069985 Jun 16 00:38:00.379157 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 474/964] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:00 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1087 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:01.396801 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-13c5e117-bd5b-407a-8ca1-caaf121f625a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:01.398124 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-13c5e117-bd5b-407a-8ca1-caaf121f625a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:01.406225 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-13c5e117-bd5b-407a-8ca1-caaf121f625a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:01.406672 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-13c5e117-bd5b-407a-8ca1-caaf121f625a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:01.407812 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-13c5e117-bd5b-407a-8ca1-caaf121f625a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:01.408816 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-13c5e117-bd5b-407a-8ca1-caaf121f625a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:01.495614 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-13c5e117-bd5b-407a-8ca1-caaf121f625a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:01.503456 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-13c5e117-bd5b-407a-8ca1-caaf121f625a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1193 microversion: 2.1 time: 0.111105 Jun 16 00:38:01.512923 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 491/965] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:01 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1193 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:38:02.521189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-70753239-e489-48ed-8484-674f5e5c562a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:02.521737 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-70753239-e489-48ed-8484-674f5e5c562a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:02.528106 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-70753239-e489-48ed-8484-674f5e5c562a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:02.528550 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-70753239-e489-48ed-8484-674f5e5c562a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:02.529342 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-70753239-e489-48ed-8484-674f5e5c562a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:02.529811 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-70753239-e489-48ed-8484-674f5e5c562a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:02.662992 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-70753239-e489-48ed-8484-674f5e5c562a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:02.672672 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-70753239-e489-48ed-8484-674f5e5c562a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1259 microversion: 2.1 time: 0.155341 Jun 16 00:38:02.673363 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 475/966] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:02 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:02.975262 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-a8664f78-b3e5-4216-a7c2-c76c3c61310e req-4329ca06-3565-4610-a601-5494d1261b4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5632c271-69b0-4502-aa9f-3a1f9b85420a", "tag": "7c3669e1-4a5b-4855-a4d1-f27ecf3cd7d5"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:02.986592 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-a8664f78-b3e5-4216-a7c2-c76c3c61310e req-4329ca06-3565-4610-a601-5494d1261b4f service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:02.986592 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-a8664f78-b3e5-4216-a7c2-c76c3c61310e req-4329ca06-3565-4610-a601-5494d1261b4f service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:03.003076 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-a8664f78-b3e5-4216-a7c2-c76c3c61310e req-4329ca06-3565-4610-a601-5494d1261b4f service nova] Creating event network-changed:7c3669e1-4a5b-4855-a4d1-f27ecf3cd7d5 for instance 5632c271-69b0-4502-aa9f-3a1f9b85420a on hv-cinder-84599 Jun 16 00:38:03.008122 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-a8664f78-b3e5-4216-a7c2-c76c3c61310e req-4329ca06-3565-4610-a601-5494d1261b4f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104335 Jun 16 00:38:03.008799 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 492/967] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:38:03.690606 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-6df232eb-5b0e-4244-9526-d34a628ca2c3 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:03.691227 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-6df232eb-5b0e-4244-9526-d34a628ca2c3 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:03.698468 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6df232eb-5b0e-4244-9526-d34a628ca2c3 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:03.698913 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6df232eb-5b0e-4244-9526-d34a628ca2c3 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:03.699672 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6df232eb-5b0e-4244-9526-d34a628ca2c3 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:03.700107 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6df232eb-5b0e-4244-9526-d34a628ca2c3 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:03.835090 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-6df232eb-5b0e-4244-9526-d34a628ca2c3 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:03.843065 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-6df232eb-5b0e-4244-9526-d34a628ca2c3 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1259 microversion: 2.1 time: 0.157126 Jun 16 00:38:03.843635 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 476/968] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:03 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:04.861091 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-9ba503b7-cd39-4d89-b1b5-08d41e099057 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:04.861788 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-9ba503b7-cd39-4d89-b1b5-08d41e099057 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:04.868110 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9ba503b7-cd39-4d89-b1b5-08d41e099057 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:04.868552 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9ba503b7-cd39-4d89-b1b5-08d41e099057 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:04.869335 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9ba503b7-cd39-4d89-b1b5-08d41e099057 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:04.869766 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9ba503b7-cd39-4d89-b1b5-08d41e099057 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:05.004200 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-9ba503b7-cd39-4d89-b1b5-08d41e099057 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:05.011708 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-9ba503b7-cd39-4d89-b1b5-08d41e099057 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1259 microversion: 2.1 time: 0.155796 Jun 16 00:38:05.012273 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 493/969] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:04 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:06.029404 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-273a5aaf-fc57-4ece-b30c-054cdfa7e1a5 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:06.030764 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-273a5aaf-fc57-4ece-b30c-054cdfa7e1a5 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:06.036897 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-273a5aaf-fc57-4ece-b30c-054cdfa7e1a5 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:06.037347 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-273a5aaf-fc57-4ece-b30c-054cdfa7e1a5 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:06.038090 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-273a5aaf-fc57-4ece-b30c-054cdfa7e1a5 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:06.038513 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-273a5aaf-fc57-4ece-b30c-054cdfa7e1a5 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:06.169910 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-273a5aaf-fc57-4ece-b30c-054cdfa7e1a5 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:06.177839 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-273a5aaf-fc57-4ece-b30c-054cdfa7e1a5 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1259 microversion: 2.1 time: 0.152386 Jun 16 00:38:06.178439 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 477/970] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:06 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:07.195118 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-4b965b35-213b-4dee-9478-63ef6c463e85 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:07.195719 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-4b965b35-213b-4dee-9478-63ef6c463e85 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:07.202792 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4b965b35-213b-4dee-9478-63ef6c463e85 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:07.203230 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4b965b35-213b-4dee-9478-63ef6c463e85 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:07.204000 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4b965b35-213b-4dee-9478-63ef6c463e85 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:07.204425 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-4b965b35-213b-4dee-9478-63ef6c463e85 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:07.334433 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-4b965b35-213b-4dee-9478-63ef6c463e85 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:07.341776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-4b965b35-213b-4dee-9478-63ef6c463e85 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1259 microversion: 2.1 time: 0.150503 Jun 16 00:38:07.343060 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 494/971] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:07 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:08.359883 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-22dba951-87f0-4870-9572-bc9da73ee38c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:08.360525 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-22dba951-87f0-4870-9572-bc9da73ee38c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:08.367048 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-22dba951-87f0-4870-9572-bc9da73ee38c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:08.367496 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-22dba951-87f0-4870-9572-bc9da73ee38c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:08.368245 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-22dba951-87f0-4870-9572-bc9da73ee38c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:08.368674 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-22dba951-87f0-4870-9572-bc9da73ee38c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:08.502055 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-22dba951-87f0-4870-9572-bc9da73ee38c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:08.509737 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-22dba951-87f0-4870-9572-bc9da73ee38c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1259 microversion: 2.1 time: 0.154522 Jun 16 00:38:08.510301 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 478/972] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:08 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:09.527401 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b959a301-47dd-4ecb-b374-ec587bdd68a6 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:09.528021 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-b959a301-47dd-4ecb-b374-ec587bdd68a6 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:09.535524 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b959a301-47dd-4ecb-b374-ec587bdd68a6 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:09.535966 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b959a301-47dd-4ecb-b374-ec587bdd68a6 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:09.536712 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b959a301-47dd-4ecb-b374-ec587bdd68a6 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:09.537159 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b959a301-47dd-4ecb-b374-ec587bdd68a6 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:09.666571 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-b959a301-47dd-4ecb-b374-ec587bdd68a6 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:09.674961 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-b959a301-47dd-4ecb-b374-ec587bdd68a6 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1259 microversion: 2.1 time: 0.151552 Jun 16 00:38:09.675523 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 495/973] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:09 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:10.692394 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-76943f7e-d18e-462d-85f1-e6897e070634 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:10.693059 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-76943f7e-d18e-462d-85f1-e6897e070634 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:10.695383 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=2 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:10.700824 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-76943f7e-d18e-462d-85f1-e6897e070634 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:10.701966 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-76943f7e-d18e-462d-85f1-e6897e070634 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:10.702737 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-76943f7e-d18e-462d-85f1-e6897e070634 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:10.703175 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-76943f7e-d18e-462d-85f1-e6897e070634 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:10.844241 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-76943f7e-d18e-462d-85f1-e6897e070634 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:10.851643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-76943f7e-d18e-462d-85f1-e6897e070634 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1259 microversion: 2.1 time: 0.163142 Jun 16 00:38:10.852200 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 479/974] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:10 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:11.867942 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-f04bf64f-9e97-4084-9b57-136b3d6be95b tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:11.868523 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-f04bf64f-9e97-4084-9b57-136b3d6be95b tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:11.870474 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=2 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:11.871122 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=6 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:11.877141 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f04bf64f-9e97-4084-9b57-136b3d6be95b tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:11.877583 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f04bf64f-9e97-4084-9b57-136b3d6be95b tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:11.878327 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f04bf64f-9e97-4084-9b57-136b3d6be95b tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:11.878749 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-f04bf64f-9e97-4084-9b57-136b3d6be95b tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:12.014849 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-f04bf64f-9e97-4084-9b57-136b3d6be95b tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:12.022453 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-f04bf64f-9e97-4084-9b57-136b3d6be95b tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1259 microversion: 2.1 time: 0.158461 Jun 16 00:38:12.023026 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 496/975] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:11 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:13.039679 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-93686198-4077-4108-9ea6-2615cdb0c59c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:13.040213 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-93686198-4077-4108-9ea6-2615cdb0c59c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:13.047512 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-93686198-4077-4108-9ea6-2615cdb0c59c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:13.047951 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-93686198-4077-4108-9ea6-2615cdb0c59c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:13.048697 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-93686198-4077-4108-9ea6-2615cdb0c59c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:13.049148 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-93686198-4077-4108-9ea6-2615cdb0c59c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:13.180562 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-93686198-4077-4108-9ea6-2615cdb0c59c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:13.188675 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-93686198-4077-4108-9ea6-2615cdb0c59c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1259 microversion: 2.1 time: 0.152275 Jun 16 00:38:13.189239 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 480/976] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:13 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:14.205186 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-88f07641-de70-4a17-9c8a-e21f6ca84e16 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:14.205796 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-88f07641-de70-4a17-9c8a-e21f6ca84e16 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:14.212279 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-88f07641-de70-4a17-9c8a-e21f6ca84e16 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:14.212722 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-88f07641-de70-4a17-9c8a-e21f6ca84e16 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:14.213510 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-88f07641-de70-4a17-9c8a-e21f6ca84e16 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:14.213947 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-88f07641-de70-4a17-9c8a-e21f6ca84e16 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:14.345858 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-88f07641-de70-4a17-9c8a-e21f6ca84e16 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:14.353187 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-88f07641-de70-4a17-9c8a-e21f6ca84e16 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1259 microversion: 2.1 time: 0.152430 Jun 16 00:38:14.353738 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 497/977] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:14 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:15.126487 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-e8259c03-a5c4-4808-853e-f16bb2ae6c35 req-39b98c0d-2f4e-4680-b536-27f9daeafe3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5632c271-69b0-4502-aa9f-3a1f9b85420a", "name": "network-vif-plugged", "status": "completed", "tag": "7c3669e1-4a5b-4855-a4d1-f27ecf3cd7d5"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:15.134802 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-e8259c03-a5c4-4808-853e-f16bb2ae6c35 req-39b98c0d-2f4e-4680-b536-27f9daeafe3d service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:15.135240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-e8259c03-a5c4-4808-853e-f16bb2ae6c35 req-39b98c0d-2f4e-4680-b536-27f9daeafe3d service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:15.147420 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-e8259c03-a5c4-4808-853e-f16bb2ae6c35 req-39b98c0d-2f4e-4680-b536-27f9daeafe3d service nova] Creating event network-vif-plugged:7c3669e1-4a5b-4855-a4d1-f27ecf3cd7d5 for instance 5632c271-69b0-4502-aa9f-3a1f9b85420a on hv-cinder-84599 Jun 16 00:38:15.152553 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-e8259c03-a5c4-4808-853e-f16bb2ae6c35 req-39b98c0d-2f4e-4680-b536-27f9daeafe3d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101747 Jun 16 00:38:15.153239 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 481/978] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:38:15.370371 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-af22bd76-d181-49d0-8f03-157cad3c0d36 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:15.370985 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-af22bd76-d181-49d0-8f03-157cad3c0d36 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:15.377587 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-af22bd76-d181-49d0-8f03-157cad3c0d36 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:15.378077 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-af22bd76-d181-49d0-8f03-157cad3c0d36 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:15.378840 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-af22bd76-d181-49d0-8f03-157cad3c0d36 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:15.379269 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-af22bd76-d181-49d0-8f03-157cad3c0d36 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:15.528600 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-af22bd76-d181-49d0-8f03-157cad3c0d36 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:15.539530 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-af22bd76-d181-49d0-8f03-157cad3c0d36 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1259 microversion: 2.1 time: 0.172803 Jun 16 00:38:15.540168 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 498/979] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:15 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:16.564728 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d07b4030-604b-4974-86f8-809344f96cb5 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:16.565483 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d07b4030-604b-4974-86f8-809344f96cb5 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:16.571893 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d07b4030-604b-4974-86f8-809344f96cb5 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:16.572339 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d07b4030-604b-4974-86f8-809344f96cb5 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:16.573157 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d07b4030-604b-4974-86f8-809344f96cb5 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:16.573608 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d07b4030-604b-4974-86f8-809344f96cb5 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:16.712479 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d07b4030-604b-4974-86f8-809344f96cb5 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:16.720865 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d07b4030-604b-4974-86f8-809344f96cb5 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1259 microversion: 2.1 time: 0.161504 Jun 16 00:38:16.721788 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 482/980] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:16 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:17.738111 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-71ba67a9-bc01-4189-8e70-2e3ffd98577a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:17.738720 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-71ba67a9-bc01-4189-8e70-2e3ffd98577a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:17.745241 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-71ba67a9-bc01-4189-8e70-2e3ffd98577a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:17.745685 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-71ba67a9-bc01-4189-8e70-2e3ffd98577a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:17.746439 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-71ba67a9-bc01-4189-8e70-2e3ffd98577a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:17.746869 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-71ba67a9-bc01-4189-8e70-2e3ffd98577a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:17.880195 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-71ba67a9-bc01-4189-8e70-2e3ffd98577a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:17.887655 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-71ba67a9-bc01-4189-8e70-2e3ffd98577a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1442 microversion: 2.1 time: 0.154024 Jun 16 00:38:17.888220 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 499/981] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:17 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1442 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:17.903843 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-f482ef2e-fbf5-4a47-8669-5e985c0bfe09 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:17.904534 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-f482ef2e-fbf5-4a47-8669-5e985c0bfe09 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:17.911939 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f482ef2e-fbf5-4a47-8669-5e985c0bfe09 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:17.912460 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f482ef2e-fbf5-4a47-8669-5e985c0bfe09 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:17.913315 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f482ef2e-fbf5-4a47-8669-5e985c0bfe09 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:17.913781 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-f482ef2e-fbf5-4a47-8669-5e985c0bfe09 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:18.055109 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-f482ef2e-fbf5-4a47-8669-5e985c0bfe09 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:18.062729 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-f482ef2e-fbf5-4a47-8669-5e985c0bfe09 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1442 microversion: 2.1 time: 0.162679 Jun 16 00:38:18.063337 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 483/982] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:17 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1442 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:38:19.953273 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-fa34bf16-4928-4d4a-a68c-07ca235f5b1a req-a7d975aa-4c2c-43be-8f29-a962ef1d8691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5632c271-69b0-4502-aa9f-3a1f9b85420a", "tag": "7c3669e1-4a5b-4855-a4d1-f27ecf3cd7d5"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:19.961474 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-fa34bf16-4928-4d4a-a68c-07ca235f5b1a req-a7d975aa-4c2c-43be-8f29-a962ef1d8691 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:19.961963 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-fa34bf16-4928-4d4a-a68c-07ca235f5b1a req-a7d975aa-4c2c-43be-8f29-a962ef1d8691 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:19.972720 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-fa34bf16-4928-4d4a-a68c-07ca235f5b1a req-a7d975aa-4c2c-43be-8f29-a962ef1d8691 service nova] Creating event network-changed:7c3669e1-4a5b-4855-a4d1-f27ecf3cd7d5 for instance 5632c271-69b0-4502-aa9f-3a1f9b85420a on hv-cinder-84599 Jun 16 00:38:19.977768 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-fa34bf16-4928-4d4a-a68c-07ca235f5b1a req-a7d975aa-4c2c-43be-8f29-a962ef1d8691 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085883 Jun 16 00:38:19.978293 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 500/983] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:38:24.771728 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-2d738a2f-f8ae-4017-8383-c87e3f19a3b1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-835114084", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1933822337", "security_groups": [{"name": "tempest-secgroup-smoke-1587681135"}], "block_device_mapping_v2": [{"uuid": "7b9359e4-69e4-4d53-9bdf-d634425a4216", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7336ae8f-8600-4e86-b586-ccb4abcd0dc1"}]}} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:24.881877 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.network.neutron [None req-2d738a2f-f8ae-4017-8383-c87e3f19a3b1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] validate_networks() for [('7336ae8f-8600-4e86-b586-ccb4abcd0dc1', None, None, None, None, None)] {{(pid=124230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:38:25.294364 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-2d738a2f-f8ae-4017-8383-c87e3f19a3b1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Flavor limits 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:38:25.294785 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-2d738a2f-f8ae-4017-8383-c87e3f19a3b1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Image limits 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:38:25.295258 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-2d738a2f-f8ae-4017-8383-c87e3f19a3b1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Flavor pref 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:38:25.295667 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-2d738a2f-f8ae-4017-8383-c87e3f19a3b1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Image pref 0:0:0 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:38:25.296077 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.virt.hardware [None req-2d738a2f-f8ae-4017-8383-c87e3f19a3b1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:38:25.305586 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2d738a2f-f8ae-4017-8383-c87e3f19a3b1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:25.306037 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2d738a2f-f8ae-4017-8383-c87e3f19a3b1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:25.306869 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2d738a2f-f8ae-4017-8383-c87e3f19a3b1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:25.307305 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2d738a2f-f8ae-4017-8383-c87e3f19a3b1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:25.324814 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-2d738a2f-f8ae-4017-8383-c87e3f19a3b1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Getting quotas for project 193571b962dc4fa1aac98a6acbdc9370. Resources: {'ram', 'cores', 'instances'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:38:25.328730 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.quota [None req-2d738a2f-f8ae-4017-8383-c87e3f19a3b1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Getting quotas for user 728f4031df4148fe9ec9bf9ab31d25e5 and project 193571b962dc4fa1aac98a6acbdc9370. Resources: {'ram', 'cores', 'instances'} {{(pid=124230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:38:25.384113 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-2d738a2f-f8ae-4017-8383-c87e3f19a3b1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Going to run 1 instances... {{(pid=124230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:38:25.386287 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-2d738a2f-f8ae-4017-8383-c87e3f19a3b1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 7643107a-8252-4a82-8df0-6674510271ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7b9359e4-69e4-4d53-9bdf-d634425a4216',volume_size=None,volume_type=None)] {{(pid=124230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:38:25.519757 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-2d738a2f-f8ae-4017-8383-c87e3f19a3b1 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.752640 Jun 16 00:38:25.520404 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 484/984] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Jun 16 00:38:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:38:25.530723 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-00407be5-ef91-45a8-b743-aff1dc257a5c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:25.531421 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-00407be5-ef91-45a8-b743-aff1dc257a5c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 7643107a-8252-4a82-8df0-6674510271ac] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:25.588221 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-00407be5-ef91-45a8-b743-aff1dc257a5c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:25.594858 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-00407be5-ef91-45a8-b743-aff1dc257a5c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac" status: 200 len: 1094 microversion: 2.1 time: 0.068319 Jun 16 00:38:25.596787 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 501/985] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:25 2022] GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:26.613669 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8302941d-2a6a-487b-aa5d-97d1ff831c40 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:26.614279 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-8302941d-2a6a-487b-aa5d-97d1ff831c40 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 7643107a-8252-4a82-8df0-6674510271ac] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:26.621700 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8302941d-2a6a-487b-aa5d-97d1ff831c40 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:26.622179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8302941d-2a6a-487b-aa5d-97d1ff831c40 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:26.623002 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8302941d-2a6a-487b-aa5d-97d1ff831c40 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:26.623468 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8302941d-2a6a-487b-aa5d-97d1ff831c40 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:26.689756 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-8302941d-2a6a-487b-aa5d-97d1ff831c40 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:26.698614 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-8302941d-2a6a-487b-aa5d-97d1ff831c40 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac" status: 200 len: 1210 microversion: 2.1 time: 0.089614 Jun 16 00:38:26.699496 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 485/986] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:26 2022] GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:27.715633 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-72cd8fdd-4e17-4ede-90d3-25dcd525b4bb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:27.716221 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-72cd8fdd-4e17-4ede-90d3-25dcd525b4bb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 7643107a-8252-4a82-8df0-6674510271ac] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:27.724202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-72cd8fdd-4e17-4ede-90d3-25dcd525b4bb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:27.724645 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-72cd8fdd-4e17-4ede-90d3-25dcd525b4bb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:27.725440 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-72cd8fdd-4e17-4ede-90d3-25dcd525b4bb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:27.726041 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-72cd8fdd-4e17-4ede-90d3-25dcd525b4bb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:27.948223 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-d81853c0-7bc2-4fa9-9f44-2814fcf4df32 req-28b5711b-38e6-49db-8a60-7229e4a51e4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7643107a-8252-4a82-8df0-6674510271ac", "tag": "ea975100-102d-4219-bb5a-78add5515edf"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:27.962913 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-d81853c0-7bc2-4fa9-9f44-2814fcf4df32 req-28b5711b-38e6-49db-8a60-7229e4a51e4f service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:27.963878 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-d81853c0-7bc2-4fa9-9f44-2814fcf4df32 req-28b5711b-38e6-49db-8a60-7229e4a51e4f service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:27.979955 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-72cd8fdd-4e17-4ede-90d3-25dcd525b4bb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:27.983072 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-d81853c0-7bc2-4fa9-9f44-2814fcf4df32 req-28b5711b-38e6-49db-8a60-7229e4a51e4f service nova] Creating event network-changed:ea975100-102d-4219-bb5a-78add5515edf for instance 7643107a-8252-4a82-8df0-6674510271ac on hv-cinder-84599 Jun 16 00:38:27.987895 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-d81853c0-7bc2-4fa9-9f44-2814fcf4df32 req-28b5711b-38e6-49db-8a60-7229e4a51e4f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043473 Jun 16 00:38:27.988645 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 486/987] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:38:27.992354 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-72cd8fdd-4e17-4ede-90d3-25dcd525b4bb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac" status: 200 len: 1266 microversion: 2.1 time: 0.280532 Jun 16 00:38:27.992959 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 502/988] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:27 2022] GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac => generated 1266 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:29.062621 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-ceee545f-ffef-47da-b817-6367154c9c68 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:29.063316 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-ceee545f-ffef-47da-b817-6367154c9c68 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 7643107a-8252-4a82-8df0-6674510271ac] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:29.069575 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ceee545f-ffef-47da-b817-6367154c9c68 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:29.070011 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ceee545f-ffef-47da-b817-6367154c9c68 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:29.070765 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ceee545f-ffef-47da-b817-6367154c9c68 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:29.071189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-ceee545f-ffef-47da-b817-6367154c9c68 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:29.208604 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-ceee545f-ffef-47da-b817-6367154c9c68 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:29.216042 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-ceee545f-ffef-47da-b817-6367154c9c68 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac" status: 200 len: 1266 microversion: 2.1 time: 0.210412 Jun 16 00:38:29.216598 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 487/989] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:29 2022] GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:30.232847 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-b25ef800-902b-4d22-bb08-020820bac294 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:30.233471 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-b25ef800-902b-4d22-bb08-020820bac294 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 7643107a-8252-4a82-8df0-6674510271ac] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:30.235826 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:30.241783 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b25ef800-902b-4d22-bb08-020820bac294 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:30.242229 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b25ef800-902b-4d22-bb08-020820bac294 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:30.242973 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b25ef800-902b-4d22-bb08-020820bac294 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:30.243397 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-b25ef800-902b-4d22-bb08-020820bac294 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:30.246734 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=61 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:30.374514 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-b25ef800-902b-4d22-bb08-020820bac294 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:30.381956 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-b25ef800-902b-4d22-bb08-020820bac294 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac" status: 200 len: 1266 microversion: 2.1 time: 0.152930 Jun 16 00:38:30.382511 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 503/990] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:30 2022] GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:31.399891 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-e4163b12-e9be-4c89-92cb-53838d8605ae tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:31.400481 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-e4163b12-e9be-4c89-92cb-53838d8605ae tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 7643107a-8252-4a82-8df0-6674510271ac] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:31.402868 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:31.408304 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e4163b12-e9be-4c89-92cb-53838d8605ae tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:31.408776 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e4163b12-e9be-4c89-92cb-53838d8605ae tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:31.409578 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e4163b12-e9be-4c89-92cb-53838d8605ae tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:31.410606 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e4163b12-e9be-4c89-92cb-53838d8605ae tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:31.415484 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=67 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:31.547214 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-e4163b12-e9be-4c89-92cb-53838d8605ae tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:31.555328 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-e4163b12-e9be-4c89-92cb-53838d8605ae tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac" status: 200 len: 1266 microversion: 2.1 time: 0.159393 Jun 16 00:38:31.555896 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 488/991] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:31 2022] GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:32.571281 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-3adb560a-28e0-4b53-9b0e-738258fa561e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:32.571879 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-3adb560a-28e0-4b53-9b0e-738258fa561e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 7643107a-8252-4a82-8df0-6674510271ac] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:32.580066 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3adb560a-28e0-4b53-9b0e-738258fa561e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:32.580514 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3adb560a-28e0-4b53-9b0e-738258fa561e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:32.581325 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3adb560a-28e0-4b53-9b0e-738258fa561e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:32.582945 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3adb560a-28e0-4b53-9b0e-738258fa561e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:32.714201 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-3adb560a-28e0-4b53-9b0e-738258fa561e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:32.721905 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-3adb560a-28e0-4b53-9b0e-738258fa561e tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac" status: 200 len: 1266 microversion: 2.1 time: 0.154554 Jun 16 00:38:32.722569 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 504/992] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:32 2022] GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:33.738844 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-1e82b6ad-2f4c-4c94-aaa6-ce302f05106c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:33.739450 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-1e82b6ad-2f4c-4c94-aaa6-ce302f05106c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 7643107a-8252-4a82-8df0-6674510271ac] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:33.745887 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1e82b6ad-2f4c-4c94-aaa6-ce302f05106c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:33.746328 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1e82b6ad-2f4c-4c94-aaa6-ce302f05106c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:33.747080 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1e82b6ad-2f4c-4c94-aaa6-ce302f05106c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:33.747509 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1e82b6ad-2f4c-4c94-aaa6-ce302f05106c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:33.878524 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-1e82b6ad-2f4c-4c94-aaa6-ce302f05106c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:33.885969 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-1e82b6ad-2f4c-4c94-aaa6-ce302f05106c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac" status: 200 len: 1266 microversion: 2.1 time: 0.151035 Jun 16 00:38:33.886567 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 489/993] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:33 2022] GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:34.903599 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-0b0d2b06-818f-46be-b3d5-1e7e863b4edc tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:34.904202 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-0b0d2b06-818f-46be-b3d5-1e7e863b4edc tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 7643107a-8252-4a82-8df0-6674510271ac] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:34.913030 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0b0d2b06-818f-46be-b3d5-1e7e863b4edc tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:34.913470 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0b0d2b06-818f-46be-b3d5-1e7e863b4edc tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:34.914225 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0b0d2b06-818f-46be-b3d5-1e7e863b4edc tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:34.914655 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0b0d2b06-818f-46be-b3d5-1e7e863b4edc tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:35.049618 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-0b0d2b06-818f-46be-b3d5-1e7e863b4edc tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:35.057744 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-0b0d2b06-818f-46be-b3d5-1e7e863b4edc tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac" status: 200 len: 1266 microversion: 2.1 time: 0.157932 Jun 16 00:38:35.058303 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 505/994] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:34 2022] GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:36.075334 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-e5848fe7-bce9-4d0f-ac35-d0b0aa6b4c45 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:36.075944 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-e5848fe7-bce9-4d0f-ac35-d0b0aa6b4c45 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 7643107a-8252-4a82-8df0-6674510271ac] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:36.078243 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=2 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:36.078894 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell0:SELECT=6 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:36.087073 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e5848fe7-bce9-4d0f-ac35-d0b0aa6b4c45 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:36.087864 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e5848fe7-bce9-4d0f-ac35-d0b0aa6b4c45 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:36.089232 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e5848fe7-bce9-4d0f-ac35-d0b0aa6b4c45 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:36.089936 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-e5848fe7-bce9-4d0f-ac35-d0b0aa6b4c45 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:36.219930 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-e5848fe7-bce9-4d0f-ac35-d0b0aa6b4c45 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:36.227359 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-e5848fe7-bce9-4d0f-ac35-d0b0aa6b4c45 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac" status: 200 len: 1266 microversion: 2.1 time: 0.155960 Jun 16 00:38:36.227949 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 490/995] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:36 2022] GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:37.245284 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-0d30d15b-c2a7-4375-9f5c-d08e28ccbe72 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:37.245853 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-0d30d15b-c2a7-4375-9f5c-d08e28ccbe72 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 7643107a-8252-4a82-8df0-6674510271ac] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:37.247715 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell0:SELECT=2 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:37.254169 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0d30d15b-c2a7-4375-9f5c-d08e28ccbe72 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:37.254621 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0d30d15b-c2a7-4375-9f5c-d08e28ccbe72 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:37.255377 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0d30d15b-c2a7-4375-9f5c-d08e28ccbe72 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:37.256481 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0d30d15b-c2a7-4375-9f5c-d08e28ccbe72 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:37.389523 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-0d30d15b-c2a7-4375-9f5c-d08e28ccbe72 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:37.397232 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-0d30d15b-c2a7-4375-9f5c-d08e28ccbe72 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac" status: 200 len: 1266 microversion: 2.1 time: 0.155782 Jun 16 00:38:37.398019 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 506/996] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:37 2022] GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:38.414052 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-c63fad07-8c5d-47fe-982f-c81d4c2d7470 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:38.414646 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-c63fad07-8c5d-47fe-982f-c81d4c2d7470 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 7643107a-8252-4a82-8df0-6674510271ac] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:38.421078 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c63fad07-8c5d-47fe-982f-c81d4c2d7470 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:38.421519 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c63fad07-8c5d-47fe-982f-c81d4c2d7470 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:38.422298 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c63fad07-8c5d-47fe-982f-c81d4c2d7470 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:38.422722 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-c63fad07-8c5d-47fe-982f-c81d4c2d7470 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:38.556242 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-c63fad07-8c5d-47fe-982f-c81d4c2d7470 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:38.563716 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-c63fad07-8c5d-47fe-982f-c81d4c2d7470 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac" status: 200 len: 1266 microversion: 2.1 time: 0.153759 Jun 16 00:38:38.564282 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 491/997] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:38 2022] GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:39.080939 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-15412b02-7294-4093-bf2d-dadd4ed565a4 req-3e3506d9-6850-4a08-9137-31c10094f6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7643107a-8252-4a82-8df0-6674510271ac", "name": "network-vif-plugged", "status": "completed", "tag": "ea975100-102d-4219-bb5a-78add5515edf"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:39.090455 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-15412b02-7294-4093-bf2d-dadd4ed565a4 req-3e3506d9-6850-4a08-9137-31c10094f6a3 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:39.090902 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-15412b02-7294-4093-bf2d-dadd4ed565a4 req-3e3506d9-6850-4a08-9137-31c10094f6a3 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:39.102703 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-15412b02-7294-4093-bf2d-dadd4ed565a4 req-3e3506d9-6850-4a08-9137-31c10094f6a3 service nova] Creating event network-vif-plugged:ea975100-102d-4219-bb5a-78add5515edf for instance 7643107a-8252-4a82-8df0-6674510271ac on hv-cinder-84599 Jun 16 00:38:39.107594 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-15412b02-7294-4093-bf2d-dadd4ed565a4 req-3e3506d9-6850-4a08-9137-31c10094f6a3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030443 Jun 16 00:38:39.108188 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 507/998] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:38:39.580258 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-9bc6e439-3912-45ed-94c5-ae4eacf75d36 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:39.580852 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-9bc6e439-3912-45ed-94c5-ae4eacf75d36 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 7643107a-8252-4a82-8df0-6674510271ac] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:39.587583 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9bc6e439-3912-45ed-94c5-ae4eacf75d36 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:39.587960 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9bc6e439-3912-45ed-94c5-ae4eacf75d36 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:39.588707 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9bc6e439-3912-45ed-94c5-ae4eacf75d36 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:39.589171 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9bc6e439-3912-45ed-94c5-ae4eacf75d36 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:39.721887 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-9bc6e439-3912-45ed-94c5-ae4eacf75d36 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:39.730413 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-9bc6e439-3912-45ed-94c5-ae4eacf75d36 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac" status: 200 len: 1266 microversion: 2.1 time: 0.153954 Jun 16 00:38:39.731010 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 492/999] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:39 2022] GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:40.748425 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-0eff8206-79b2-46e8-b0f0-5c9430720568 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:40.749152 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-0eff8206-79b2-46e8-b0f0-5c9430720568 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 7643107a-8252-4a82-8df0-6674510271ac] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:40.755807 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0eff8206-79b2-46e8-b0f0-5c9430720568 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:40.756251 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0eff8206-79b2-46e8-b0f0-5c9430720568 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:40.757025 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0eff8206-79b2-46e8-b0f0-5c9430720568 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:40.757457 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-0eff8206-79b2-46e8-b0f0-5c9430720568 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:40.892192 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-0eff8206-79b2-46e8-b0f0-5c9430720568 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:40.900682 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-0eff8206-79b2-46e8-b0f0-5c9430720568 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac" status: 200 len: 1266 microversion: 2.1 time: 0.156880 Jun 16 00:38:40.901309 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 508/1000] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:40 2022] GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:41.918119 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-bd79f2fc-1509-4230-a0ed-3dc34f45e520 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:41.918721 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-bd79f2fc-1509-4230-a0ed-3dc34f45e520 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 7643107a-8252-4a82-8df0-6674510271ac] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:41.925226 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bd79f2fc-1509-4230-a0ed-3dc34f45e520 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:41.926631 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bd79f2fc-1509-4230-a0ed-3dc34f45e520 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:41.927384 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bd79f2fc-1509-4230-a0ed-3dc34f45e520 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:41.927812 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-bd79f2fc-1509-4230-a0ed-3dc34f45e520 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:42.062494 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-bd79f2fc-1509-4230-a0ed-3dc34f45e520 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:42.070681 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-bd79f2fc-1509-4230-a0ed-3dc34f45e520 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac" status: 200 len: 1453 microversion: 2.1 time: 0.156426 Jun 16 00:38:42.071247 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 493/1001] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:41 2022] GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:42.087655 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-893c400f-3a17-4b33-9ca8-254b3ef0c48c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:42.088258 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-893c400f-3a17-4b33-9ca8-254b3ef0c48c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 7643107a-8252-4a82-8df0-6674510271ac] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:42.094240 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-893c400f-3a17-4b33-9ca8-254b3ef0c48c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:42.094679 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-893c400f-3a17-4b33-9ca8-254b3ef0c48c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:42.095426 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-893c400f-3a17-4b33-9ca8-254b3ef0c48c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:42.095852 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-893c400f-3a17-4b33-9ca8-254b3ef0c48c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:42.227395 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-893c400f-3a17-4b33-9ca8-254b3ef0c48c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:42.234776 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-893c400f-3a17-4b33-9ca8-254b3ef0c48c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac" status: 200 len: 1453 microversion: 2.1 time: 0.151109 Jun 16 00:38:42.235328 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 509/1002] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:42 2022] GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:43.808034 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-50a3ea8f-39de-4031-bb62-9cecdc6902d5 req-dbd61473-7867-4219-b8a2-7f07b8369f45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7643107a-8252-4a82-8df0-6674510271ac", "tag": "ea975100-102d-4219-bb5a-78add5515edf"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:43.817399 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-50a3ea8f-39de-4031-bb62-9cecdc6902d5 req-dbd61473-7867-4219-b8a2-7f07b8369f45 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:43.817844 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-50a3ea8f-39de-4031-bb62-9cecdc6902d5 req-dbd61473-7867-4219-b8a2-7f07b8369f45 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:43.828829 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-50a3ea8f-39de-4031-bb62-9cecdc6902d5 req-dbd61473-7867-4219-b8a2-7f07b8369f45 service nova] Creating event network-changed:ea975100-102d-4219-bb5a-78add5515edf for instance 7643107a-8252-4a82-8df0-6674510271ac on hv-cinder-84599 Jun 16 00:38:43.834600 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-50a3ea8f-39de-4031-bb62-9cecdc6902d5 req-dbd61473-7867-4219-b8a2-7f07b8369f45 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030458 Jun 16 00:38:43.835202 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 494/1003] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:40:12.772710 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3aaf0f0b-adc8-4b51-b8c8-77a8898f3e3b] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 16 00:40:12.773936 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=13 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:12.774908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=37 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:12.775543 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=13 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:12.776308 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=37 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:12.780338 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-83a43dbf-d705-4b34-abe9-f55e0d1642f3 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:12.780920 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-c128998d-0cde-4a97-a747-aecfd8d4e120 req-d03294c6-9fb5-4911-8e1b-9743ad5db84c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7643107a-8252-4a82-8df0-6674510271ac", "tag": "ea975100-102d-4219-bb5a-78add5515edf"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:40:12.781097 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-83a43dbf-d705-4b34-abe9-f55e0d1642f3 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 7643107a-8252-4a82-8df0-6674510271ac] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:12.787960 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-83a43dbf-d705-4b34-abe9-f55e0d1642f3 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:12.790409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-c128998d-0cde-4a97-a747-aecfd8d4e120 req-d03294c6-9fb5-4911-8e1b-9743ad5db84c service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:12.790545 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-83a43dbf-d705-4b34-abe9-f55e0d1642f3 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:12.790860 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-c128998d-0cde-4a97-a747-aecfd8d4e120 req-d03294c6-9fb5-4911-8e1b-9743ad5db84c service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:12.791186 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-83a43dbf-d705-4b34-abe9-f55e0d1642f3 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:12.791617 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-83a43dbf-d705-4b34-abe9-f55e0d1642f3 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:12.804269 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-c128998d-0cde-4a97-a747-aecfd8d4e120 req-d03294c6-9fb5-4911-8e1b-9743ad5db84c service nova] Creating event network-changed:ea975100-102d-4219-bb5a-78add5515edf for instance 7643107a-8252-4a82-8df0-6674510271ac on hv-cinder-84599 Jun 16 00:40:12.810529 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-c128998d-0cde-4a97-a747-aecfd8d4e120 req-d03294c6-9fb5-4911-8e1b-9743ad5db84c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037284 Jun 16 00:40:12.811672 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 495/1004] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:40:12.821817 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-83a43dbf-d705-4b34-abe9-f55e0d1642f3 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 7643107a-8252-4a82-8df0-6674510271ac] Going to try to terminate instance {{(pid=124231) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:40:12.905337 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-83a43dbf-d705-4b34-abe9-f55e0d1642f3 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac" status: 204 len: 0 microversion: 2.1 time: 0.134336 Jun 16 00:40:12.909316 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 510/1005] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:40:12 2022] DELETE /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:40:12.915004 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-fbfffde1-526a-49cd-a868-d88ab36faabb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:12.915696 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-fbfffde1-526a-49cd-a868-d88ab36faabb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 7643107a-8252-4a82-8df0-6674510271ac] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:12.923744 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fbfffde1-526a-49cd-a868-d88ab36faabb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:12.924188 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fbfffde1-526a-49cd-a868-d88ab36faabb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:12.924984 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fbfffde1-526a-49cd-a868-d88ab36faabb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:12.925417 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-fbfffde1-526a-49cd-a868-d88ab36faabb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:13.064786 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-fbfffde1-526a-49cd-a868-d88ab36faabb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:13.072509 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-fbfffde1-526a-49cd-a868-d88ab36faabb tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac" status: 200 len: 1578 microversion: 2.1 time: 0.161727 Jun 16 00:40:13.073101 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 496/1006] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:12 2022] GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:14.090888 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-ae4e3300-731b-4286-aa7f-be0c4be593e4 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:14.091579 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-ae4e3300-731b-4286-aa7f-be0c4be593e4 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 7643107a-8252-4a82-8df0-6674510271ac] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:14.099191 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ae4e3300-731b-4286-aa7f-be0c4be593e4 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:14.099642 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ae4e3300-731b-4286-aa7f-be0c4be593e4 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:14.100401 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ae4e3300-731b-4286-aa7f-be0c4be593e4 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:14.100831 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ae4e3300-731b-4286-aa7f-be0c4be593e4 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:14.107306 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO oslo.messaging._drivers.impl_rabbit [-] [3aaf0f0b-adc8-4b51-b8c8-77a8898f3e3b] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38994. Jun 16 00:40:14.269178 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-ae4e3300-731b-4286-aa7f-be0c4be593e4 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:14.277642 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-ae4e3300-731b-4286-aa7f-be0c4be593e4 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac" status: 200 len: 1578 microversion: 2.1 time: 0.191325 Jun 16 00:40:14.278442 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 511/1007] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:14 2022] GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac => generated 1578 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:40:15.198245 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-0680ee38-f9b5-4372-b084-119931f080f7 req-a3c83775-e0a6-46f0-94c7-6eba217ada77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7643107a-8252-4a82-8df0-6674510271ac", "name": "network-vif-deleted", "tag": "ea975100-102d-4219-bb5a-78add5515edf"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:40:15.207939 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-0680ee38-f9b5-4372-b084-119931f080f7 req-a3c83775-e0a6-46f0-94c7-6eba217ada77 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:15.208458 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-0680ee38-f9b5-4372-b084-119931f080f7 req-a3c83775-e0a6-46f0-94c7-6eba217ada77 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:15.221284 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-0680ee38-f9b5-4372-b084-119931f080f7 req-a3c83775-e0a6-46f0-94c7-6eba217ada77 service nova] Creating event network-vif-deleted:ea975100-102d-4219-bb5a-78add5515edf for instance 7643107a-8252-4a82-8df0-6674510271ac on hv-cinder-84599 Jun 16 00:40:15.226788 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-0680ee38-f9b5-4372-b084-119931f080f7 req-a3c83775-e0a6-46f0-94c7-6eba217ada77 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031951 Jun 16 00:40:15.227378 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 497/1008] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:40:15.294917 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-fdb19dd7-6644-4ff0-9093-12b568ed7ab8 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:15.295545 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-fdb19dd7-6644-4ff0-9093-12b568ed7ab8 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 7643107a-8252-4a82-8df0-6674510271ac] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:15.302147 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fdb19dd7-6644-4ff0-9093-12b568ed7ab8 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:15.302664 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fdb19dd7-6644-4ff0-9093-12b568ed7ab8 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:15.303426 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fdb19dd7-6644-4ff0-9093-12b568ed7ab8 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:15.303879 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-fdb19dd7-6644-4ff0-9093-12b568ed7ab8 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:15.369602 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-fdb19dd7-6644-4ff0-9093-12b568ed7ab8 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:15.377843 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-fdb19dd7-6644-4ff0-9093-12b568ed7ab8 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac" status: 200 len: 1225 microversion: 2.1 time: 0.086925 Jun 16 00:40:15.378496 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 512/1009] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:15 2022] GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:16.397447 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8b1fc7c4-9d23-4cd7-b1e6-c799f764f5a3 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:16.398146 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-8b1fc7c4-9d23-4cd7-b1e6-c799f764f5a3 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 7643107a-8252-4a82-8df0-6674510271ac] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:16.406327 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8b1fc7c4-9d23-4cd7-b1e6-c799f764f5a3 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:16.406783 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8b1fc7c4-9d23-4cd7-b1e6-c799f764f5a3 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:16.407845 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8b1fc7c4-9d23-4cd7-b1e6-c799f764f5a3 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:16.408284 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-8b1fc7c4-9d23-4cd7-b1e6-c799f764f5a3 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:16.422707 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-8b1fc7c4-9d23-4cd7-b1e6-c799f764f5a3 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] HTTP exception thrown: Instance 7643107a-8252-4a82-8df0-6674510271ac could not be found. Jun 16 00:40:16.424323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8b1fc7c4-9d23-4cd7-b1e6-c799f764f5a3 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Request method failure captured: Jun 16 00:40:16.424323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac HTTP/1.1 Jun 16 00:40:16.424323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:40:16.424323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:40:16.424323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:40:16.424323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:40:16.424323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:40:16.424323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:40:16.424323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:40:16.424323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:40:16.424323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnpQzdGa4d0-6coN85jiITqtaVaXt9dclwoHXU-AtrV7TnRKBhQ1Fy-tggtCmlOtZOfk-2-wRZWJR0qI9Gu_gZQrmjT2RuXABZJkE0xz9CY7ByMcZRpeworsPSy4K2FXkUHwwXk6AJCL6P76LxZ-dOz9b9-H9hvaydj500viXX4nxlA Jun 16 00:40:16.424323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:40:16.424323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:40:16.424323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:40:16.424323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:40:16.424323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:40:16.424323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:40:16.424323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: 193571b962dc4fa1aac98a6acbdc9370 Jun 16 00:40:16.424323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-TestVolumeBootPattern-1913642732 Jun 16 00:40:16.424323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:40:16.424323 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:40:16.426179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_193571b962dc4fa1aac98a6acbdc9370"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/193571b962dc4fa1aac98a6acbdc9370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/193571b962dc4fa1aac98a6acbdc9370"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/193571b962dc4fa1aac98a6acbdc9370"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:40:16.426179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-TestVolumeBootPattern-1913642732 Jun 16 00:40:16.426179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: 193571b962dc4fa1aac98a6acbdc9370 Jun 16 00:40:16.426179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-TestVolumeBootPattern-1913642732 Jun 16 00:40:16.426179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-TestVolumeBootPattern-1913642732-project Jun 16 00:40:16.426179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:40:16.426179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:40:16.426179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: 728f4031df4148fe9ec9bf9ab31d25e5 Jun 16 00:40:16.426179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-TestVolumeBootPattern-1913642732-project Jun 16 00:40:16.426179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: > Jun 16 00:40:16.426179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Instance 7643107a-8252-4a82-8df0-6674510271ac could not be found. Jun 16 00:40:16.426179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'id': '7643107a-8252-4a82-8df0-6674510271ac'} Jun 16 00:40:16.427134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:40:16.427134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:40:16.427134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:40:16.427134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:40:16.427134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:40:16.427134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:40:16.427134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:40:16.427134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:40:16.427134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:40:16.427134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:40:16.427134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7643107a-8252-4a82-8df0-6674510271ac could not be found. Jun 16 00:40:16.427134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:40:16.427134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:40:16.427134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:40:16.427134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:40:16.427134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:40:16.427134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:40:16.427134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:40:16.427134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:40:16.427134 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:40:16.428736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:40:16.428736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:40:16.428736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:40:16.428736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:40:16.428736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:40:16.428736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:40:16.428736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:40:16.428736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7643107a-8252-4a82-8df0-6674510271ac could not be found. Jun 16 00:40:16.428736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:40:16.428736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:40:16.428736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:40:16.428736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:40:16.428736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:40:16.428736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:40:16.428736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:40:16.428736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:40:16.428736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7643107a-8252-4a82-8df0-6674510271ac could not be found. Jun 16 00:40:16.428736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:40:16.430200 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-8b1fc7c4-9d23-4cd7-b1e6-c799f764f5a3 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Returning 404 to user: Instance 7643107a-8252-4a82-8df0-6674510271ac could not be found. {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:40:16.430200 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-8b1fc7c4-9d23-4cd7-b1e6-c799f764f5a3 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac" status: 404 len: 111 microversion: 2.1 time: 0.033319 Jun 16 00:40:16.430200 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 498/1010] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:16 2022] GET /compute/v2.1/servers/7643107a-8252-4a82-8df0-6674510271ac => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:40:17.893039 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-c968f265-3888-449a-b4e1-209f6808a542 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:40:17.893655 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-c968f265-3888-449a-b4e1-209f6808a542 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:17.901798 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c968f265-3888-449a-b4e1-209f6808a542 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:17.903678 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c968f265-3888-449a-b4e1-209f6808a542 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:17.905051 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c968f265-3888-449a-b4e1-209f6808a542 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:17.907741 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c968f265-3888-449a-b4e1-209f6808a542 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:17.934716 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.objects.instance [None req-c968f265-3888-449a-b4e1-209f6808a542 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lazy-loading 'flavor' on Instance uuid 5632c271-69b0-4502-aa9f-3a1f9b85420a {{(pid=124231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:40:18.005188 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-c968f265-3888-449a-b4e1-209f6808a542 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "POST /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a/action" status: 202 len: 0 microversion: 2.1 time: 0.117115 Jun 16 00:40:18.005770 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 513/1011] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Jun 16 00:40:17 2022] POST /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:40:18.014389 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-31f5ce88-02fa-46be-99a0-e3b3f3929e4a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:18.015642 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-31f5ce88-02fa-46be-99a0-e3b3f3929e4a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:18.022489 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-31f5ce88-02fa-46be-99a0-e3b3f3929e4a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:18.022966 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-31f5ce88-02fa-46be-99a0-e3b3f3929e4a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:18.023778 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-31f5ce88-02fa-46be-99a0-e3b3f3929e4a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:18.024275 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-31f5ce88-02fa-46be-99a0-e3b3f3929e4a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:18.159796 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-31f5ce88-02fa-46be-99a0-e3b3f3929e4a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:18.167386 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-31f5ce88-02fa-46be-99a0-e3b3f3929e4a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1566 microversion: 2.1 time: 0.157427 Jun 16 00:40:18.168599 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 499/1012] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:18 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:19.185602 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-9b6f5f36-692a-4273-96b4-ff1cd009d29d tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:19.186297 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-9b6f5f36-692a-4273-96b4-ff1cd009d29d tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:19.192871 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9b6f5f36-692a-4273-96b4-ff1cd009d29d tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:19.193340 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9b6f5f36-692a-4273-96b4-ff1cd009d29d tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:19.194101 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9b6f5f36-692a-4273-96b4-ff1cd009d29d tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:19.194529 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-9b6f5f36-692a-4273-96b4-ff1cd009d29d tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:19.413292 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-9b6f5f36-692a-4273-96b4-ff1cd009d29d tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:19.420933 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-9b6f5f36-692a-4273-96b4-ff1cd009d29d tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1566 microversion: 2.1 time: 0.240151 Jun 16 00:40:19.421869 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 514/1013] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:19 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1566 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:19.555254 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-1acd38cd-2d1f-4a8f-8cad-44703723abfc tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:19.555742 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-1acd38cd-2d1f-4a8f-8cad-44703723abfc tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:19.562925 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1acd38cd-2d1f-4a8f-8cad-44703723abfc tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:19.563702 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1acd38cd-2d1f-4a8f-8cad-44703723abfc tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:19.564115 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-2ef1ba9b-f74a-471e-ad27-274195e7ffb4 req-19115345-d0a0-49aa-9bad-3eed4168798c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8", "tag": "37d0519d-bed0-4032-aef6-086b99f07e85"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:40:19.564478 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1acd38cd-2d1f-4a8f-8cad-44703723abfc tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:19.565190 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1acd38cd-2d1f-4a8f-8cad-44703723abfc tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:19.572191 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-2ef1ba9b-f74a-471e-ad27-274195e7ffb4 req-19115345-d0a0-49aa-9bad-3eed4168798c service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:19.572632 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-2ef1ba9b-f74a-471e-ad27-274195e7ffb4 req-19115345-d0a0-49aa-9bad-3eed4168798c service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:19.584140 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-2ef1ba9b-f74a-471e-ad27-274195e7ffb4 req-19115345-d0a0-49aa-9bad-3eed4168798c service nova] Creating event network-changed:37d0519d-bed0-4032-aef6-086b99f07e85 for instance 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 on hv-cinder-84599 Jun 16 00:40:19.589037 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-2ef1ba9b-f74a-471e-ad27-274195e7ffb4 req-19115345-d0a0-49aa-9bad-3eed4168798c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028697 Jun 16 00:40:19.590686 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 515/1014] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:40:19.595084 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-1acd38cd-2d1f-4a8f-8cad-44703723abfc tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Going to try to terminate instance {{(pid=124230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:40:19.682524 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-1acd38cd-2d1f-4a8f-8cad-44703723abfc tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 204 len: 0 microversion: 2.1 time: 0.130295 Jun 16 00:40:19.685095 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 500/1015] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:40:19 2022] DELETE /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:40:19.695514 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d6629917-fe45-46a1-88cd-99271a86e50c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:19.696217 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-d6629917-fe45-46a1-88cd-99271a86e50c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:19.708454 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d6629917-fe45-46a1-88cd-99271a86e50c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:19.710052 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d6629917-fe45-46a1-88cd-99271a86e50c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:19.710958 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d6629917-fe45-46a1-88cd-99271a86e50c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:19.711456 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d6629917-fe45-46a1-88cd-99271a86e50c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:19.853704 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d6629917-fe45-46a1-88cd-99271a86e50c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:19.861406 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-d6629917-fe45-46a1-88cd-99271a86e50c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1579 microversion: 2.1 time: 0.171489 Jun 16 00:40:19.862233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 516/1016] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:19 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1579 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:20.137918 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:40:20.138145 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Thu Jun 16 00:40:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:40:20.438868 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-4deb5bac-1dc9-4aa1-9276-e927574e47fd tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:20.439643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-4deb5bac-1dc9-4aa1-9276-e927574e47fd tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:20.449577 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4deb5bac-1dc9-4aa1-9276-e927574e47fd tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:20.450026 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4deb5bac-1dc9-4aa1-9276-e927574e47fd tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:20.450793 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4deb5bac-1dc9-4aa1-9276-e927574e47fd tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:20.451258 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4deb5bac-1dc9-4aa1-9276-e927574e47fd tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:20.583354 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-4deb5bac-1dc9-4aa1-9276-e927574e47fd tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:20.591385 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-4deb5bac-1dc9-4aa1-9276-e927574e47fd tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1566 microversion: 2.1 time: 0.156788 Jun 16 00:40:20.591936 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 501/1017] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:20 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:20.879247 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-c67ac1a9-47f7-4400-8cde-b8982e7b0b21 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:20.879840 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-c67ac1a9-47f7-4400-8cde-b8982e7b0b21 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:20.896392 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c67ac1a9-47f7-4400-8cde-b8982e7b0b21 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:20.896841 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c67ac1a9-47f7-4400-8cde-b8982e7b0b21 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:20.897658 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c67ac1a9-47f7-4400-8cde-b8982e7b0b21 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:20.898091 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c67ac1a9-47f7-4400-8cde-b8982e7b0b21 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:21.045475 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-c67ac1a9-47f7-4400-8cde-b8982e7b0b21 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:21.053157 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-c67ac1a9-47f7-4400-8cde-b8982e7b0b21 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1579 microversion: 2.1 time: 0.177667 Jun 16 00:40:21.061301 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 517/1018] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:20 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1579 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:21.608065 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-3f9ea045-e943-46fe-837a-a0c913b30a05 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:21.610135 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-3f9ea045-e943-46fe-837a-a0c913b30a05 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:21.616747 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3f9ea045-e943-46fe-837a-a0c913b30a05 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:21.617222 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3f9ea045-e943-46fe-837a-a0c913b30a05 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:21.617983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3f9ea045-e943-46fe-837a-a0c913b30a05 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:21.618409 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3f9ea045-e943-46fe-837a-a0c913b30a05 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:21.805642 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-3f9ea045-e943-46fe-837a-a0c913b30a05 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:21.814103 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-3f9ea045-e943-46fe-837a-a0c913b30a05 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1566 microversion: 2.1 time: 0.210460 Jun 16 00:40:21.814679 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 502/1019] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:21 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1566 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:21.897263 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-1edbea37-946f-48a9-9478-c1f6b0832918 req-a00afa9f-1a14-45c1-914e-c3a12916185f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8", "name": "network-vif-deleted", "tag": "37d0519d-bed0-4032-aef6-086b99f07e85"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:40:21.907757 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-1edbea37-946f-48a9-9478-c1f6b0832918 req-a00afa9f-1a14-45c1-914e-c3a12916185f service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:21.908279 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-1edbea37-946f-48a9-9478-c1f6b0832918 req-a00afa9f-1a14-45c1-914e-c3a12916185f service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:21.921468 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.compute.server_external_events [req-1edbea37-946f-48a9-9478-c1f6b0832918 req-a00afa9f-1a14-45c1-914e-c3a12916185f service nova] Creating event network-vif-deleted:37d0519d-bed0-4032-aef6-086b99f07e85 for instance 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 on hv-cinder-84599 Jun 16 00:40:21.926263 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-1edbea37-946f-48a9-9478-c1f6b0832918 req-a00afa9f-1a14-45c1-914e-c3a12916185f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033074 Jun 16 00:40:21.926842 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 518/1020] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:40:22.071584 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-6ddeafc8-97de-46a3-955c-4d1ed1a6e674 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:22.072423 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-6ddeafc8-97de-46a3-955c-4d1ed1a6e674 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:22.078987 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6ddeafc8-97de-46a3-955c-4d1ed1a6e674 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:22.079432 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6ddeafc8-97de-46a3-955c-4d1ed1a6e674 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:22.080193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6ddeafc8-97de-46a3-955c-4d1ed1a6e674 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:22.080626 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-6ddeafc8-97de-46a3-955c-4d1ed1a6e674 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:22.147333 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-6ddeafc8-97de-46a3-955c-4d1ed1a6e674 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728f4031df4148fe9ec9bf9ab31d25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193571b962dc4fa1aac98a6acbdc9370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:22.156154 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-6ddeafc8-97de-46a3-955c-4d1ed1a6e674 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 200 len: 1226 microversion: 2.1 time: 0.088994 Jun 16 00:40:22.157115 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 503/1021] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:22 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:22.832026 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-14db5ab8-e119-4fd6-a47b-145efebbaad8 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:22.832728 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-14db5ab8-e119-4fd6-a47b-145efebbaad8 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:22.839100 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-14db5ab8-e119-4fd6-a47b-145efebbaad8 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:22.840481 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-14db5ab8-e119-4fd6-a47b-145efebbaad8 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:22.840481 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-14db5ab8-e119-4fd6-a47b-145efebbaad8 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:22.840906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-14db5ab8-e119-4fd6-a47b-145efebbaad8 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:22.981153 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-14db5ab8-e119-4fd6-a47b-145efebbaad8 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:22.988556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-14db5ab8-e119-4fd6-a47b-145efebbaad8 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1566 microversion: 2.1 time: 0.160929 Jun 16 00:40:22.989142 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 519/1022] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:22 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:23.172826 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5f532cc2-5640-47ae-85cd-0dddb27cad18 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:23.173382 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-5f532cc2-5640-47ae-85cd-0dddb27cad18 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:23.179506 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5f532cc2-5640-47ae-85cd-0dddb27cad18 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:23.180016 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5f532cc2-5640-47ae-85cd-0dddb27cad18 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:23.180771 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5f532cc2-5640-47ae-85cd-0dddb27cad18 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:23.181231 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5f532cc2-5640-47ae-85cd-0dddb27cad18 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:23.195317 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-5f532cc2-5640-47ae-85cd-0dddb27cad18 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] HTTP exception thrown: Instance 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 could not be found. Jun 16 00:40:23.196937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5f532cc2-5640-47ae-85cd-0dddb27cad18 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Request method failure captured: Jun 16 00:40:23.196937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 HTTP/1.1 Jun 16 00:40:23.196937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:40:23.196937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:40:23.196937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:40:23.196937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:40:23.196937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:40:23.196937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:40:23.196937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:40:23.196937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:40:23.196937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnpQzdGa4d0-6coN85jiITqtaVaXt9dclwoHXU-AtrV7TnRKBhQ1Fy-tggtCmlOtZOfk-2-wRZWJR0qI9Gu_gZQrmjT2RuXABZJkE0xz9CY7ByMcZRpeworsPSy4K2FXkUHwwXk6AJCL6P76LxZ-dOz9b9-H9hvaydj500viXX4nxlA Jun 16 00:40:23.196937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:40:23.196937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:40:23.196937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:40:23.196937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:40:23.196937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:40:23.196937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:40:23.196937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: 193571b962dc4fa1aac98a6acbdc9370 Jun 16 00:40:23.196937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-TestVolumeBootPattern-1913642732 Jun 16 00:40:23.196937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:40:23.196937 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:40:23.198570 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_193571b962dc4fa1aac98a6acbdc9370"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/193571b962dc4fa1aac98a6acbdc9370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/193571b962dc4fa1aac98a6acbdc9370"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/193571b962dc4fa1aac98a6acbdc9370"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:40:23.198570 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-TestVolumeBootPattern-1913642732 Jun 16 00:40:23.198570 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: 193571b962dc4fa1aac98a6acbdc9370 Jun 16 00:40:23.198570 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-TestVolumeBootPattern-1913642732 Jun 16 00:40:23.198570 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-TestVolumeBootPattern-1913642732-project Jun 16 00:40:23.198570 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:40:23.198570 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:40:23.198570 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: 728f4031df4148fe9ec9bf9ab31d25e5 Jun 16 00:40:23.198570 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-TestVolumeBootPattern-1913642732-project Jun 16 00:40:23.198570 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: > Jun 16 00:40:23.198570 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Instance 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 could not be found. Jun 16 00:40:23.198570 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'id': '8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8'} Jun 16 00:40:23.199974 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:40:23.199974 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:40:23.199974 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:40:23.199974 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:40:23.199974 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:40:23.199974 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:40:23.199974 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:40:23.199974 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:40:23.199974 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:40:23.199974 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:40:23.199974 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 could not be found. Jun 16 00:40:23.199974 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:40:23.199974 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:40:23.199974 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:40:23.199974 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:40:23.199974 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:40:23.199974 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:40:23.199974 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:40:23.199974 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:40:23.199974 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:40:23.201544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:40:23.201544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:40:23.201544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:40:23.201544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:40:23.201544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:40:23.201544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:40:23.201544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:40:23.201544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 could not be found. Jun 16 00:40:23.201544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:40:23.201544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:40:23.201544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:40:23.201544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:40:23.201544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:40:23.201544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:40:23.201544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:40:23.201544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:40:23.201544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 could not be found. Jun 16 00:40:23.201544 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:40:23.203038 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5f532cc2-5640-47ae-85cd-0dddb27cad18 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Returning 404 to user: Instance 8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 could not be found. {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:40:23.203038 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-5f532cc2-5640-47ae-85cd-0dddb27cad18 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8" status: 404 len: 111 microversion: 2.1 time: 0.029558 Jun 16 00:40:23.203038 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 504/1023] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:23 2022] GET /compute/v2.1/servers/8c7e98ca-4ca1-4f2a-813f-a5451a93b2d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:40:23.640742 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-60c3cc06-24f5-40c9-9b6c-010b14c1ea4c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:23.641420 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-60c3cc06-24f5-40c9-9b6c-010b14c1ea4c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:23.647583 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-60c3cc06-24f5-40c9-9b6c-010b14c1ea4c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:23.648022 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-60c3cc06-24f5-40c9-9b6c-010b14c1ea4c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:23.648763 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-60c3cc06-24f5-40c9-9b6c-010b14c1ea4c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:23.649213 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-60c3cc06-24f5-40c9-9b6c-010b14c1ea4c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:23.662914 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.wsgi [None req-60c3cc06-24f5-40c9-9b6c-010b14c1ea4c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] HTTP exception thrown: Instance a2bccd7b-433f-4329-9ab3-fceb9fc211d9 could not be found. Jun 16 00:40:23.664577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-60c3cc06-24f5-40c9-9b6c-010b14c1ea4c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Request method failure captured: Jun 16 00:40:23.664577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: request: DELETE /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 HTTP/1.1 Jun 16 00:40:23.664577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept: application/json Jun 16 00:40:23.664577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Accept-Encoding: identity Jun 16 00:40:23.664577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Connection: close Jun 16 00:40:23.664577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Length: 0 Jun 16 00:40:23.664577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Content-Type: application/json Jun 16 00:40:23.664577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Host: 10.222.0.23 Jun 16 00:40:23.664577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Openstack-System-Scope: None Jun 16 00:40:23.664577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: User-Agent: python-urllib3/1.26.9 Jun 16 00:40:23.664577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Auth-Token: gAAAAABiqnpQzdGa4d0-6coN85jiITqtaVaXt9dclwoHXU-AtrV7TnRKBhQ1Fy-tggtCmlOtZOfk-2-wRZWJR0qI9Gu_gZQrmjT2RuXABZJkE0xz9CY7ByMcZRpeworsPSy4K2FXkUHwwXk6AJCL6P76LxZ-dOz9b9-H9hvaydj500viXX4nxlA Jun 16 00:40:23.664577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Id: None Jun 16 00:40:23.664577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Domain-Name: None Jun 16 00:40:23.664577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Identity-Status: Confirmed Jun 16 00:40:23.664577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Is-Admin-Project: True Jun 16 00:40:23.664577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Id: default Jun 16 00:40:23.664577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Domain-Name: Default Jun 16 00:40:23.664577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Id: 193571b962dc4fa1aac98a6acbdc9370 Jun 16 00:40:23.664577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Project-Name: tempest-TestVolumeBootPattern-1913642732 Jun 16 00:40:23.664577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Role: member,reader Jun 16 00:40:23.664577 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Roles: member,reader Jun 16 00:40:23.666319 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_193571b962dc4fa1aac98a6acbdc9370"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/193571b962dc4fa1aac98a6acbdc9370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/193571b962dc4fa1aac98a6acbdc9370"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/193571b962dc4fa1aac98a6acbdc9370"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:40:23.666319 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant: tempest-TestVolumeBootPattern-1913642732 Jun 16 00:40:23.666319 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Id: 193571b962dc4fa1aac98a6acbdc9370 Jun 16 00:40:23.666319 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-Tenant-Name: tempest-TestVolumeBootPattern-1913642732 Jun 16 00:40:23.666319 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User: tempest-TestVolumeBootPattern-1913642732-project Jun 16 00:40:23.666319 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Id: default Jun 16 00:40:23.666319 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Domain-Name: Default Jun 16 00:40:23.666319 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Id: 728f4031df4148fe9ec9bf9ab31d25e5 Jun 16 00:40:23.666319 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: X-User-Name: tempest-TestVolumeBootPattern-1913642732-project Jun 16 00:40:23.666319 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: method: > Jun 16 00:40:23.666319 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: exception: Instance a2bccd7b-433f-4329-9ab3-fceb9fc211d9 could not be found. Jun 16 00:40:23.666319 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: action_args: {'id': 'a2bccd7b-433f-4329-9ab3-fceb9fc211d9'} Jun 16 00:40:23.667233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:40:23.667233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:40:23.667233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:40:23.667233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:40:23.667233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:40:23.667233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:40:23.667233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:40:23.667233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:40:23.667233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:40:23.667233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:40:23.667233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2bccd7b-433f-4329-9ab3-fceb9fc211d9 could not be found. Jun 16 00:40:23.667233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:40:23.667233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:40:23.667233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:40:23.667233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:40:23.667233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:40:23.667233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:40:23.667233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:40:23.667233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:40:23.667233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:40:23.669498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:40:23.669498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:40:23.669498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:40:23.669498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:40:23.669498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:40:23.669498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:40:23.669498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:40:23.669498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:40:23.669498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:40:23.669498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2bccd7b-433f-4329-9ab3-fceb9fc211d9 could not be found. Jun 16 00:40:23.669498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:40:23.669498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:40:23.669498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:40:23.669498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:40:23.669498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:40:23.669498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:40:23.669498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:40:23.669498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:40:23.669498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2bccd7b-433f-4329-9ab3-fceb9fc211d9 could not be found. Jun 16 00:40:23.669498 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR nova.api.openstack.wsgi Jun 16 00:40:23.671107 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-60c3cc06-24f5-40c9-9b6c-010b14c1ea4c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Returning 404 to user: Instance a2bccd7b-433f-4329-9ab3-fceb9fc211d9 could not be found. {{(pid=124231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:40:23.671107 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-60c3cc06-24f5-40c9-9b6c-010b14c1ea4c tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9" status: 404 len: 111 microversion: 2.1 time: 0.029113 Jun 16 00:40:23.671107 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 520/1024] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:40:23 2022] DELETE /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:40:23.675016 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-08eaf401-b6b3-4507-8c00-125fbd8032ce tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:23.675621 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-08eaf401-b6b3-4507-8c00-125fbd8032ce tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] [instance: a2bccd7b-433f-4329-9ab3-fceb9fc211d9] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:23.682942 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-08eaf401-b6b3-4507-8c00-125fbd8032ce tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:23.683613 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-08eaf401-b6b3-4507-8c00-125fbd8032ce tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:23.684411 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-08eaf401-b6b3-4507-8c00-125fbd8032ce tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:23.684837 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-08eaf401-b6b3-4507-8c00-125fbd8032ce tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:23.698072 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-08eaf401-b6b3-4507-8c00-125fbd8032ce tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] HTTP exception thrown: Instance a2bccd7b-433f-4329-9ab3-fceb9fc211d9 could not be found. Jun 16 00:40:23.699595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-08eaf401-b6b3-4507-8c00-125fbd8032ce tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Request method failure captured: Jun 16 00:40:23.699595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 HTTP/1.1 Jun 16 00:40:23.699595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:40:23.699595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:40:23.699595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:40:23.699595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:40:23.699595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:40:23.699595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:40:23.699595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:40:23.699595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:40:23.699595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqnpQzdGa4d0-6coN85jiITqtaVaXt9dclwoHXU-AtrV7TnRKBhQ1Fy-tggtCmlOtZOfk-2-wRZWJR0qI9Gu_gZQrmjT2RuXABZJkE0xz9CY7ByMcZRpeworsPSy4K2FXkUHwwXk6AJCL6P76LxZ-dOz9b9-H9hvaydj500viXX4nxlA Jun 16 00:40:23.699595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:40:23.699595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:40:23.699595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:40:23.699595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:40:23.699595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:40:23.699595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:40:23.699595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: 193571b962dc4fa1aac98a6acbdc9370 Jun 16 00:40:23.699595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-TestVolumeBootPattern-1913642732 Jun 16 00:40:23.699595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:40:23.699595 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:40:23.701229 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_193571b962dc4fa1aac98a6acbdc9370"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/193571b962dc4fa1aac98a6acbdc9370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/193571b962dc4fa1aac98a6acbdc9370"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/193571b962dc4fa1aac98a6acbdc9370"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:40:23.701229 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-TestVolumeBootPattern-1913642732 Jun 16 00:40:23.701229 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: 193571b962dc4fa1aac98a6acbdc9370 Jun 16 00:40:23.701229 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-TestVolumeBootPattern-1913642732 Jun 16 00:40:23.701229 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-TestVolumeBootPattern-1913642732-project Jun 16 00:40:23.701229 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:40:23.701229 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:40:23.701229 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: 728f4031df4148fe9ec9bf9ab31d25e5 Jun 16 00:40:23.701229 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-TestVolumeBootPattern-1913642732-project Jun 16 00:40:23.701229 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: > Jun 16 00:40:23.701229 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Instance a2bccd7b-433f-4329-9ab3-fceb9fc211d9 could not be found. Jun 16 00:40:23.701229 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'id': 'a2bccd7b-433f-4329-9ab3-fceb9fc211d9'} Jun 16 00:40:23.702193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:40:23.702193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:40:23.702193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:40:23.702193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:40:23.702193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:40:23.702193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:40:23.702193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:40:23.702193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:40:23.702193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:40:23.702193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:40:23.702193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2bccd7b-433f-4329-9ab3-fceb9fc211d9 could not be found. Jun 16 00:40:23.702193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:40:23.702193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:40:23.702193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:40:23.702193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:40:23.702193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:40:23.702193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:40:23.702193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:40:23.702193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:40:23.702193 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:40:23.703720 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:40:23.703720 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:40:23.703720 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:40:23.703720 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:40:23.703720 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:40:23.703720 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:40:23.703720 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:40:23.703720 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2bccd7b-433f-4329-9ab3-fceb9fc211d9 could not be found. Jun 16 00:40:23.703720 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:40:23.703720 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:40:23.703720 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:40:23.703720 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:40:23.703720 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:40:23.703720 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:40:23.703720 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:40:23.703720 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:40:23.703720 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2bccd7b-433f-4329-9ab3-fceb9fc211d9 could not be found. Jun 16 00:40:23.703720 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:40:23.705079 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-08eaf401-b6b3-4507-8c00-125fbd8032ce tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Returning 404 to user: Instance a2bccd7b-433f-4329-9ab3-fceb9fc211d9 could not be found. {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:40:23.705079 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-08eaf401-b6b3-4507-8c00-125fbd8032ce tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9" status: 404 len: 111 microversion: 2.1 time: 0.029725 Jun 16 00:40:23.705079 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 505/1025] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:23 2022] GET /compute/v2.1/servers/a2bccd7b-433f-4329-9ab3-fceb9fc211d9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:40:24.005480 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-49e1ea6b-bd88-4cfd-9f12-08b51fa2657e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:24.006080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-49e1ea6b-bd88-4cfd-9f12-08b51fa2657e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:24.013275 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-49e1ea6b-bd88-4cfd-9f12-08b51fa2657e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:24.013714 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-49e1ea6b-bd88-4cfd-9f12-08b51fa2657e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:24.014463 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-49e1ea6b-bd88-4cfd-9f12-08b51fa2657e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:24.014885 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-49e1ea6b-bd88-4cfd-9f12-08b51fa2657e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:24.144346 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-49e1ea6b-bd88-4cfd-9f12-08b51fa2657e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:24.151957 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-49e1ea6b-bd88-4cfd-9f12-08b51fa2657e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1566 microversion: 2.1 time: 0.150252 Jun 16 00:40:24.153131 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 521/1026] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:24 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:24.989325 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-caed920a-63d5-4e85-a159-8884e0b9a3d3 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] Calling method '.version_select at 0x7fe7053cda60>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:25.010908 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-caed920a-63d5-4e85-a159-8884e0b9a3d3 tempest-TestVolumeBootPattern-1913642732 tempest-TestVolumeBootPattern-1913642732-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1933822337" status: 202 len: 0 microversion: 2.1 time: 0.025404 Jun 16 00:40:25.014969 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 506/1027] 10.222.0.23 () {58 vars in 1262 bytes} [Thu Jun 16 00:40:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1933822337 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:40:25.170245 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-39e00666-6c42-4181-b33d-e2aba990dffd tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:25.170788 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-39e00666-6c42-4181-b33d-e2aba990dffd tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:25.177183 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-39e00666-6c42-4181-b33d-e2aba990dffd tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:25.177630 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-39e00666-6c42-4181-b33d-e2aba990dffd tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:25.178398 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-39e00666-6c42-4181-b33d-e2aba990dffd tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:25.178828 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-39e00666-6c42-4181-b33d-e2aba990dffd tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:25.312784 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-39e00666-6c42-4181-b33d-e2aba990dffd tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:25.320582 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-39e00666-6c42-4181-b33d-e2aba990dffd tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1566 microversion: 2.1 time: 0.154853 Jun 16 00:40:25.321191 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 522/1028] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:25 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:26.339530 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-b74e9b76-9c31-46c7-a95a-d93258356bf8 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:26.340819 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-b74e9b76-9c31-46c7-a95a-d93258356bf8 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:26.347574 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b74e9b76-9c31-46c7-a95a-d93258356bf8 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:26.348030 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b74e9b76-9c31-46c7-a95a-d93258356bf8 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:26.349541 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b74e9b76-9c31-46c7-a95a-d93258356bf8 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:26.349984 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-b74e9b76-9c31-46c7-a95a-d93258356bf8 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:26.712145 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-b74e9b76-9c31-46c7-a95a-d93258356bf8 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:26.720916 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-b74e9b76-9c31-46c7-a95a-d93258356bf8 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1566 microversion: 2.1 time: 0.385798 Jun 16 00:40:26.722377 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 507/1029] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:26 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1566 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:27.739434 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-92bf9190-99a3-4198-b6a8-2f93c655aa17 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:27.740122 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-92bf9190-99a3-4198-b6a8-2f93c655aa17 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:27.747502 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-92bf9190-99a3-4198-b6a8-2f93c655aa17 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:27.748027 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-92bf9190-99a3-4198-b6a8-2f93c655aa17 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:27.748872 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-92bf9190-99a3-4198-b6a8-2f93c655aa17 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:27.749398 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-92bf9190-99a3-4198-b6a8-2f93c655aa17 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:27.899136 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-92bf9190-99a3-4198-b6a8-2f93c655aa17 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:27.908492 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-92bf9190-99a3-4198-b6a8-2f93c655aa17 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1566 microversion: 2.1 time: 0.172961 Jun 16 00:40:27.913468 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 523/1030] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:27 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:28.927253 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-5e1d810b-9c70-4357-9c06-559e46f18ee2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:28.928550 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-5e1d810b-9c70-4357-9c06-559e46f18ee2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:28.937058 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5e1d810b-9c70-4357-9c06-559e46f18ee2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:28.937515 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5e1d810b-9c70-4357-9c06-559e46f18ee2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:28.938305 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5e1d810b-9c70-4357-9c06-559e46f18ee2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:28.938739 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-5e1d810b-9c70-4357-9c06-559e46f18ee2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:29.088241 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-5e1d810b-9c70-4357-9c06-559e46f18ee2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:29.096898 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-5e1d810b-9c70-4357-9c06-559e46f18ee2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1566 microversion: 2.1 time: 0.173637 Jun 16 00:40:29.097497 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 508/1031] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:28 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:30.114066 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-3709c6b5-b147-466c-9c11-6d74d613ef99 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:30.114665 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-3709c6b5-b147-466c-9c11-6d74d613ef99 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:30.122314 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3709c6b5-b147-466c-9c11-6d74d613ef99 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:30.122839 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3709c6b5-b147-466c-9c11-6d74d613ef99 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:30.123681 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3709c6b5-b147-466c-9c11-6d74d613ef99 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:30.124194 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-3709c6b5-b147-466c-9c11-6d74d613ef99 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:30.358556 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-3709c6b5-b147-466c-9c11-6d74d613ef99 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:30.363898 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:30.373023 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-3709c6b5-b147-466c-9c11-6d74d613ef99 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1566 microversion: 2.1 time: 0.262751 Jun 16 00:40:30.382889 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 524/1032] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:30 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1566 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:31.391522 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-d446d114-eefe-47fb-ae84-45a136a0e306 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:31.392054 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-d446d114-eefe-47fb-ae84-45a136a0e306 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:31.399501 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d446d114-eefe-47fb-ae84-45a136a0e306 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:31.399948 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d446d114-eefe-47fb-ae84-45a136a0e306 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:31.400716 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d446d114-eefe-47fb-ae84-45a136a0e306 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:31.401179 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-d446d114-eefe-47fb-ae84-45a136a0e306 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:31.550442 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-d446d114-eefe-47fb-ae84-45a136a0e306 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:31.590364 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-d446d114-eefe-47fb-ae84-45a136a0e306 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1567 microversion: 2.1 time: 0.203076 Jun 16 00:40:31.606234 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 509/1033] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:31 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:31.609820 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-c1fb6240-d116-4b88-9137-bdf0c429ba44 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:40:31.610493 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-c1fb6240-d116-4b88-9137-bdf0c429ba44 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:31.619046 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c1fb6240-d116-4b88-9137-bdf0c429ba44 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:31.619812 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c1fb6240-d116-4b88-9137-bdf0c429ba44 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:31.620674 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c1fb6240-d116-4b88-9137-bdf0c429ba44 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:31.621477 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-c1fb6240-d116-4b88-9137-bdf0c429ba44 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:31.824644 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c1fb6240-d116-4b88-9137-bdf0c429ba44 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [84ef3113-178e-48e3-9a05-56a1d2cc1da0] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 00:40:32.834453 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO oslo.messaging._drivers.impl_rabbit [None req-c1fb6240-d116-4b88-9137-bdf0c429ba44 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [84ef3113-178e-48e3-9a05-56a1d2cc1da0] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39134. Jun 16 00:40:32.838199 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-c1fb6240-d116-4b88-9137-bdf0c429ba44 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "POST /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a/action" status: 202 len: 0 microversion: 2.1 time: 1.235225 Jun 16 00:40:32.843332 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 525/1034] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Jun 16 00:40:31 2022] POST /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a/action => generated 0 bytes in 1241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 00:40:32.847928 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-13b5fa3e-7770-4d26-85f9-a078c3ef6eeb tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:32.849359 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-13b5fa3e-7770-4d26-85f9-a078c3ef6eeb tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:32.858603 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-13b5fa3e-7770-4d26-85f9-a078c3ef6eeb tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:32.859059 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-13b5fa3e-7770-4d26-85f9-a078c3ef6eeb tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:32.859850 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-13b5fa3e-7770-4d26-85f9-a078c3ef6eeb tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:32.860338 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-13b5fa3e-7770-4d26-85f9-a078c3ef6eeb tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:33.046315 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-13b5fa3e-7770-4d26-85f9-a078c3ef6eeb tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:33.054548 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-13b5fa3e-7770-4d26-85f9-a078c3ef6eeb tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1515 microversion: 2.1 time: 0.210481 Jun 16 00:40:33.055234 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 510/1035] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:32 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1515 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:34.072028 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-d981c4e3-f68a-4c03-8163-d09993367b52 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:34.072637 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-d981c4e3-f68a-4c03-8163-d09993367b52 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:34.081880 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d981c4e3-f68a-4c03-8163-d09993367b52 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:34.082332 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d981c4e3-f68a-4c03-8163-d09993367b52 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:34.083090 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d981c4e3-f68a-4c03-8163-d09993367b52 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:34.083526 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-d981c4e3-f68a-4c03-8163-d09993367b52 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:34.212942 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-d981c4e3-f68a-4c03-8163-d09993367b52 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:34.221248 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-d981c4e3-f68a-4c03-8163-d09993367b52 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1515 microversion: 2.1 time: 0.153569 Jun 16 00:40:34.222138 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 526/1036] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:34 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:35.238799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-3e1c429f-0067-4154-aa11-c5b0a00d023e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:35.239406 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-3e1c429f-0067-4154-aa11-c5b0a00d023e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:35.247235 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3e1c429f-0067-4154-aa11-c5b0a00d023e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:35.247681 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3e1c429f-0067-4154-aa11-c5b0a00d023e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:35.248444 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3e1c429f-0067-4154-aa11-c5b0a00d023e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:35.248895 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-3e1c429f-0067-4154-aa11-c5b0a00d023e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:35.378307 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-3e1c429f-0067-4154-aa11-c5b0a00d023e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:35.385735 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-3e1c429f-0067-4154-aa11-c5b0a00d023e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1515 microversion: 2.1 time: 0.150764 Jun 16 00:40:35.386332 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 511/1037] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:35 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:35.630388 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [req-302a9438-e210-4a87-bab9-75c9a5b8918f req-fb141bf9-8aff-466f-9368-01c1a6fd4643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5632c271-69b0-4502-aa9f-3a1f9b85420a", "name": "network-vif-unplugged", "status": "completed", "tag": "7c3669e1-4a5b-4855-a4d1-f27ecf3cd7d5"}]} {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:40:35.640501 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-302a9438-e210-4a87-bab9-75c9a5b8918f req-fb141bf9-8aff-466f-9368-01c1a6fd4643 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:35.640989 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [req-302a9438-e210-4a87-bab9-75c9a5b8918f req-fb141bf9-8aff-466f-9368-01c1a6fd4643 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:35.654028 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.compute.server_external_events [req-302a9438-e210-4a87-bab9-75c9a5b8918f req-fb141bf9-8aff-466f-9368-01c1a6fd4643 service nova] Unable to find a host for instance 5632c271-69b0-4502-aa9f-3a1f9b85420a. Dropping event network-vif-unplugged {{(pid=124231) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 00:40:35.654906 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [req-302a9438-e210-4a87-bab9-75c9a5b8918f req-fb141bf9-8aff-466f-9368-01c1a6fd4643 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028370 Jun 16 00:40:35.655487 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 527/1038] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 00:40:36.403536 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-7e2b3e47-6a66-4fd6-ad19-4bfca4aea662 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:36.404131 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-7e2b3e47-6a66-4fd6-ad19-4bfca4aea662 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:36.410618 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7e2b3e47-6a66-4fd6-ad19-4bfca4aea662 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:36.411058 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7e2b3e47-6a66-4fd6-ad19-4bfca4aea662 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:36.411804 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7e2b3e47-6a66-4fd6-ad19-4bfca4aea662 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:36.412234 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7e2b3e47-6a66-4fd6-ad19-4bfca4aea662 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:36.541904 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-7e2b3e47-6a66-4fd6-ad19-4bfca4aea662 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:36.549513 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-7e2b3e47-6a66-4fd6-ad19-4bfca4aea662 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1515 microversion: 2.1 time: 0.150345 Jun 16 00:40:36.550066 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 512/1039] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:36 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:37.566304 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-94bb049e-6a39-401c-a488-a3f82d9e6584 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:37.566927 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-94bb049e-6a39-401c-a488-a3f82d9e6584 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:37.573451 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-94bb049e-6a39-401c-a488-a3f82d9e6584 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:37.573929 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-94bb049e-6a39-401c-a488-a3f82d9e6584 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:37.574773 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-94bb049e-6a39-401c-a488-a3f82d9e6584 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:37.575207 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-94bb049e-6a39-401c-a488-a3f82d9e6584 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:37.714186 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-94bb049e-6a39-401c-a488-a3f82d9e6584 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:37.727237 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-94bb049e-6a39-401c-a488-a3f82d9e6584 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1515 microversion: 2.1 time: 0.164655 Jun 16 00:40:37.728045 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 528/1040] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:37 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:38.744901 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-4cca9727-6d6c-4690-b47a-a252d91d9c3e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:38.746154 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-4cca9727-6d6c-4690-b47a-a252d91d9c3e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:38.752729 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4cca9727-6d6c-4690-b47a-a252d91d9c3e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:38.753202 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4cca9727-6d6c-4690-b47a-a252d91d9c3e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:38.753955 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4cca9727-6d6c-4690-b47a-a252d91d9c3e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:38.754378 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-4cca9727-6d6c-4690-b47a-a252d91d9c3e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:38.951998 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-4cca9727-6d6c-4690-b47a-a252d91d9c3e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:38.959627 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-4cca9727-6d6c-4690-b47a-a252d91d9c3e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1573 microversion: 2.1 time: 0.218609 Jun 16 00:40:38.960194 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 513/1041] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:38 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1573 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:39.976757 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-7ddd2182-55ff-4077-94ea-b4e024beb305 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:39.977459 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-7ddd2182-55ff-4077-94ea-b4e024beb305 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:39.983927 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7ddd2182-55ff-4077-94ea-b4e024beb305 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:39.984374 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7ddd2182-55ff-4077-94ea-b4e024beb305 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:39.985165 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7ddd2182-55ff-4077-94ea-b4e024beb305 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:39.985601 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-7ddd2182-55ff-4077-94ea-b4e024beb305 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:40.116739 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-7ddd2182-55ff-4077-94ea-b4e024beb305 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:40.125109 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-7ddd2182-55ff-4077-94ea-b4e024beb305 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1573 microversion: 2.1 time: 0.151854 Jun 16 00:40:40.126137 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 529/1042] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:39 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:41.143693 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-2030c7df-ab00-4d13-9237-5805a6c430db tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:41.144299 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-2030c7df-ab00-4d13-9237-5805a6c430db tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:41.150839 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2030c7df-ab00-4d13-9237-5805a6c430db tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:41.151276 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2030c7df-ab00-4d13-9237-5805a6c430db tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:41.152649 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2030c7df-ab00-4d13-9237-5805a6c430db tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:41.153102 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-2030c7df-ab00-4d13-9237-5805a6c430db tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:41.157103 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:41.288776 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-2030c7df-ab00-4d13-9237-5805a6c430db tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:41.296365 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-2030c7df-ab00-4d13-9237-5805a6c430db tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1573 microversion: 2.1 time: 0.156859 Jun 16 00:40:41.296940 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 514/1043] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:41 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:42.313865 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-e6d562cd-abe0-490e-b886-55e4649b5967 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:42.314543 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-e6d562cd-abe0-490e-b886-55e4649b5967 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:42.321080 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e6d562cd-abe0-490e-b886-55e4649b5967 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:42.321529 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e6d562cd-abe0-490e-b886-55e4649b5967 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:42.322282 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e6d562cd-abe0-490e-b886-55e4649b5967 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:42.322710 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e6d562cd-abe0-490e-b886-55e4649b5967 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:42.449908 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-e6d562cd-abe0-490e-b886-55e4649b5967 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:42.457421 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-e6d562cd-abe0-490e-b886-55e4649b5967 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1573 microversion: 2.1 time: 0.147384 Jun 16 00:40:42.457985 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 530/1044] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:42 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1573 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:43.474907 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-aa38633c-1a3d-42ec-8739-4a9519e12d7a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:43.475467 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-aa38633c-1a3d-42ec-8739-4a9519e12d7a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:43.477733 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:43.483799 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-aa38633c-1a3d-42ec-8739-4a9519e12d7a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:43.484250 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-aa38633c-1a3d-42ec-8739-4a9519e12d7a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:43.485060 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-aa38633c-1a3d-42ec-8739-4a9519e12d7a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:43.485490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-aa38633c-1a3d-42ec-8739-4a9519e12d7a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:43.619703 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-aa38633c-1a3d-42ec-8739-4a9519e12d7a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:43.627876 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-aa38633c-1a3d-42ec-8739-4a9519e12d7a tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1573 microversion: 2.1 time: 0.156954 Jun 16 00:40:43.628440 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 515/1045] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:43 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:44.645292 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-82a003fb-78f7-4f37-aa42-54068bd346d4 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:44.645854 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-82a003fb-78f7-4f37-aa42-54068bd346d4 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:44.647862 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:44.653293 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-82a003fb-78f7-4f37-aa42-54068bd346d4 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:44.653750 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-82a003fb-78f7-4f37-aa42-54068bd346d4 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:44.654503 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-82a003fb-78f7-4f37-aa42-54068bd346d4 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:44.654925 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-82a003fb-78f7-4f37-aa42-54068bd346d4 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:44.790420 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-82a003fb-78f7-4f37-aa42-54068bd346d4 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:44.798567 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-82a003fb-78f7-4f37-aa42-54068bd346d4 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1573 microversion: 2.1 time: 0.157532 Jun 16 00:40:44.799133 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 531/1046] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:44 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:45.815608 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-9c58a038-4c3b-49c9-a4f1-70d2c9e4e378 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:45.816210 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-9c58a038-4c3b-49c9-a4f1-70d2c9e4e378 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:45.822812 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9c58a038-4c3b-49c9-a4f1-70d2c9e4e378 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:45.823257 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9c58a038-4c3b-49c9-a4f1-70d2c9e4e378 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:45.824004 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9c58a038-4c3b-49c9-a4f1-70d2c9e4e378 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:45.825087 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9c58a038-4c3b-49c9-a4f1-70d2c9e4e378 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:45.959271 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-9c58a038-4c3b-49c9-a4f1-70d2c9e4e378 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:45.967358 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-9c58a038-4c3b-49c9-a4f1-70d2c9e4e378 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1573 microversion: 2.1 time: 0.155498 Jun 16 00:40:45.967944 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 516/1047] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:45 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:46.983980 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-e0d64a89-86d2-4105-bc13-1b5906eb0c3e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:46.984579 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-e0d64a89-86d2-4105-bc13-1b5906eb0c3e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:46.991032 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e0d64a89-86d2-4105-bc13-1b5906eb0c3e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:46.991468 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e0d64a89-86d2-4105-bc13-1b5906eb0c3e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:46.992206 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e0d64a89-86d2-4105-bc13-1b5906eb0c3e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:46.992628 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-e0d64a89-86d2-4105-bc13-1b5906eb0c3e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:47.121636 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-e0d64a89-86d2-4105-bc13-1b5906eb0c3e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:47.128972 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-e0d64a89-86d2-4105-bc13-1b5906eb0c3e tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1573 microversion: 2.1 time: 0.149425 Jun 16 00:40:47.129530 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 532/1048] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:46 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:48.147240 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-7d9c6e7a-5686-4a64-9bfc-a2bda2d023a2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:48.147954 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-7d9c6e7a-5686-4a64-9bfc-a2bda2d023a2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:48.155541 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7d9c6e7a-5686-4a64-9bfc-a2bda2d023a2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:48.155985 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7d9c6e7a-5686-4a64-9bfc-a2bda2d023a2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:48.156742 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7d9c6e7a-5686-4a64-9bfc-a2bda2d023a2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:48.157202 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-7d9c6e7a-5686-4a64-9bfc-a2bda2d023a2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:48.297183 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-7d9c6e7a-5686-4a64-9bfc-a2bda2d023a2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:48.304815 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-7d9c6e7a-5686-4a64-9bfc-a2bda2d023a2 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1573 microversion: 2.1 time: 0.161679 Jun 16 00:40:48.305392 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 517/1049] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:48 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:49.322331 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-6bd7c41a-fb43-474d-858d-4e3fdb521e2b tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:49.322980 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-6bd7c41a-fb43-474d-858d-4e3fdb521e2b tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:49.330018 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6bd7c41a-fb43-474d-858d-4e3fdb521e2b tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:49.330464 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6bd7c41a-fb43-474d-858d-4e3fdb521e2b tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:49.331223 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6bd7c41a-fb43-474d-858d-4e3fdb521e2b tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:49.331656 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6bd7c41a-fb43-474d-858d-4e3fdb521e2b tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:49.466331 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-6bd7c41a-fb43-474d-858d-4e3fdb521e2b tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:49.473815 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-6bd7c41a-fb43-474d-858d-4e3fdb521e2b tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1573 microversion: 2.1 time: 0.155365 Jun 16 00:40:49.474372 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 533/1050] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:49 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:49.754273 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-51f2a1dd-13fa-4e11-9b2c-a929527d7ad8 req-947646e3-07cd-4437-8a73-d3db7325009b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5632c271-69b0-4502-aa9f-3a1f9b85420a", "name": "network-vif-plugged", "status": "completed", "tag": "7c3669e1-4a5b-4855-a4d1-f27ecf3cd7d5"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:40:49.763931 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-51f2a1dd-13fa-4e11-9b2c-a929527d7ad8 req-947646e3-07cd-4437-8a73-d3db7325009b service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:49.764380 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-51f2a1dd-13fa-4e11-9b2c-a929527d7ad8 req-947646e3-07cd-4437-8a73-d3db7325009b service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:49.775684 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-51f2a1dd-13fa-4e11-9b2c-a929527d7ad8 req-947646e3-07cd-4437-8a73-d3db7325009b service nova] Creating event network-vif-plugged:7c3669e1-4a5b-4855-a4d1-f27ecf3cd7d5 for instance 5632c271-69b0-4502-aa9f-3a1f9b85420a on hv-cinder-84599 Jun 16 00:40:49.780723 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-51f2a1dd-13fa-4e11-9b2c-a929527d7ad8 req-947646e3-07cd-4437-8a73-d3db7325009b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030251 Jun 16 00:40:49.781364 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 518/1051] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:40:50.491034 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-6359e635-4faf-436a-a3e2-2bea96c54a4c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:50.491667 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-6359e635-4faf-436a-a3e2-2bea96c54a4c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:50.498356 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6359e635-4faf-436a-a3e2-2bea96c54a4c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:50.498797 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6359e635-4faf-436a-a3e2-2bea96c54a4c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:50.499540 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6359e635-4faf-436a-a3e2-2bea96c54a4c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:50.499963 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-6359e635-4faf-436a-a3e2-2bea96c54a4c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:50.631268 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-6359e635-4faf-436a-a3e2-2bea96c54a4c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:50.638913 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-6359e635-4faf-436a-a3e2-2bea96c54a4c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1573 microversion: 2.1 time: 0.151727 Jun 16 00:40:50.639477 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 534/1052] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:50 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:51.656843 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-9b15244e-9239-4cfa-8a89-671c86a7693c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:51.657733 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-9b15244e-9239-4cfa-8a89-671c86a7693c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:51.663922 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9b15244e-9239-4cfa-8a89-671c86a7693c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:51.664364 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9b15244e-9239-4cfa-8a89-671c86a7693c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:51.665313 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9b15244e-9239-4cfa-8a89-671c86a7693c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:51.665736 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-9b15244e-9239-4cfa-8a89-671c86a7693c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:51.798646 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-9b15244e-9239-4cfa-8a89-671c86a7693c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:51.806120 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-9b15244e-9239-4cfa-8a89-671c86a7693c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1560 microversion: 2.1 time: 0.153991 Jun 16 00:40:51.806679 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 519/1053] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:51 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:08.435665 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_api:SELECT=7 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:08.439431 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_api:SELECT=9 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:08.440773 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG dbcounter [-] [124231] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:08.441533 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG dbcounter [-] [124230] Writing DB stats nova_cell1:SELECT=30 {{(pid=124230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:08.446070 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-ee9489aa-018f-4cb9-978c-da9b8cb19866 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:08.450520 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-1ba7f70f-b2fd-468e-8f14-05b8574433cf req-83336df8-038a-46b5-8df4-d2330b35852a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5632c271-69b0-4502-aa9f-3a1f9b85420a", "tag": "7c3669e1-4a5b-4855-a4d1-f27ecf3cd7d5"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:42:08.459609 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-1ba7f70f-b2fd-468e-8f14-05b8574433cf req-83336df8-038a-46b5-8df4-d2330b35852a service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:08.460047 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-1ba7f70f-b2fd-468e-8f14-05b8574433cf req-83336df8-038a-46b5-8df4-d2330b35852a service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:08.461283 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-ee9489aa-018f-4cb9-978c-da9b8cb19866 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:08.468720 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ee9489aa-018f-4cb9-978c-da9b8cb19866 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:08.469213 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ee9489aa-018f-4cb9-978c-da9b8cb19866 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:08.469979 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ee9489aa-018f-4cb9-978c-da9b8cb19866 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:08.471197 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-ee9489aa-018f-4cb9-978c-da9b8cb19866 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:08.483506 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-1ba7f70f-b2fd-468e-8f14-05b8574433cf req-83336df8-038a-46b5-8df4-d2330b35852a service nova] Creating event network-changed:7c3669e1-4a5b-4855-a4d1-f27ecf3cd7d5 for instance 5632c271-69b0-4502-aa9f-3a1f9b85420a on hv-cinder-84599 Jun 16 00:42:08.489397 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-1ba7f70f-b2fd-468e-8f14-05b8574433cf req-83336df8-038a-46b5-8df4-d2330b35852a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051889 Jun 16 00:42:08.490217 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 520/1054] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:42:08.505667 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-ee9489aa-018f-4cb9-978c-da9b8cb19866 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Going to try to terminate instance {{(pid=124231) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:42:08.587233 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-ee9489aa-018f-4cb9-978c-da9b8cb19866 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 204 len: 0 microversion: 2.1 time: 0.152934 Jun 16 00:42:08.591036 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 535/1055] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Jun 16 00:42:08 2022] DELETE /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:42:08.597795 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-1975d503-0d34-48e2-82e9-9d91cda2a11c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:08.598531 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-1975d503-0d34-48e2-82e9-9d91cda2a11c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:08.605432 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1975d503-0d34-48e2-82e9-9d91cda2a11c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:08.605938 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1975d503-0d34-48e2-82e9-9d91cda2a11c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:08.606731 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1975d503-0d34-48e2-82e9-9d91cda2a11c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:08.607189 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-1975d503-0d34-48e2-82e9-9d91cda2a11c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:09.069239 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.policy [None req-1975d503-0d34-48e2-82e9-9d91cda2a11c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:09.076971 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-1975d503-0d34-48e2-82e9-9d91cda2a11c tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1566 microversion: 2.1 time: 0.484455 Jun 16 00:42:09.077545 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 521/1056] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:08 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1566 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:42:10.096047 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-8e8b1cc1-2c8e-4d53-902f-f17492b235d3 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:10.096866 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-8e8b1cc1-2c8e-4d53-902f-f17492b235d3 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:10.103422 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8e8b1cc1-2c8e-4d53-902f-f17492b235d3 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:10.103867 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8e8b1cc1-2c8e-4d53-902f-f17492b235d3 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:10.104638 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8e8b1cc1-2c8e-4d53-902f-f17492b235d3 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:10.105130 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-8e8b1cc1-2c8e-4d53-902f-f17492b235d3 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:10.288334 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-8e8b1cc1-2c8e-4d53-902f-f17492b235d3 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:10.295882 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-8e8b1cc1-2c8e-4d53-902f-f17492b235d3 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1566 microversion: 2.1 time: 0.204738 Jun 16 00:42:10.296466 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 536/1057] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:10 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1566 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:10.879983 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [req-721a60c8-3ecd-466a-87e2-d68d9902d145 req-d27ccf9a-3b6a-4e07-a8f6-9fc8d1764324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5632c271-69b0-4502-aa9f-3a1f9b85420a", "name": "network-vif-deleted", "tag": "7c3669e1-4a5b-4855-a4d1-f27ecf3cd7d5"}]} {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:42:10.890100 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-721a60c8-3ecd-466a-87e2-d68d9902d145 req-d27ccf9a-3b6a-4e07-a8f6-9fc8d1764324 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:10.890546 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [req-721a60c8-3ecd-466a-87e2-d68d9902d145 req-d27ccf9a-3b6a-4e07-a8f6-9fc8d1764324 service nova] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:10.903443 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.compute.server_external_events [req-721a60c8-3ecd-466a-87e2-d68d9902d145 req-d27ccf9a-3b6a-4e07-a8f6-9fc8d1764324 service nova] Creating event network-vif-deleted:7c3669e1-4a5b-4855-a4d1-f27ecf3cd7d5 for instance 5632c271-69b0-4502-aa9f-3a1f9b85420a on hv-cinder-84599 Jun 16 00:42:10.909699 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [req-721a60c8-3ecd-466a-87e2-d68d9902d145 req-d27ccf9a-3b6a-4e07-a8f6-9fc8d1764324 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034752 Jun 16 00:42:10.910298 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 522/1058] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Jun 16 00:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:42:11.313320 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-83a2e9e1-25f8-4c24-a49d-334ceb6448d9 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:11.315598 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.compute.api [None req-83a2e9e1-25f8-4c24-a49d-334ceb6448d9 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124231) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:11.322368 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-83a2e9e1-25f8-4c24-a49d-334ceb6448d9 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:11.322818 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-83a2e9e1-25f8-4c24-a49d-334ceb6448d9 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:11.323603 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-83a2e9e1-25f8-4c24-a49d-334ceb6448d9 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:11.324035 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-83a2e9e1-25f8-4c24-a49d-334ceb6448d9 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:11.355597 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-83a2e9e1-25f8-4c24-a49d-334ceb6448d9 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:11.356048 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG oslo_concurrency.lockutils [None req-83a2e9e1-25f8-4c24-a49d-334ceb6448d9 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:11.356501 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.objects.instance [None req-83a2e9e1-25f8-4c24-a49d-334ceb6448d9 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lazy-loading 'fault' on Instance uuid 5632c271-69b0-4502-aa9f-3a1f9b85420a {{(pid=124231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:42:11.397960 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.policy [None req-83a2e9e1-25f8-4c24-a49d-334ceb6448d9 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218cff6f99a74a3f8e5cdd4e9787539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e831286870b24b39bc1f72f087bf970e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124231) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:11.405380 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-83a2e9e1-25f8-4c24-a49d-334ceb6448d9 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 200 len: 1223 microversion: 2.1 time: 0.096195 Jun 16 00:42:11.405947 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 537/1059] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:11 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:12.423942 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-494e6723-b677-40c5-92e2-f68aaca9eaa7 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '>' {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:12.424643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.compute.api [None req-494e6723-b677-40c5-92e2-f68aaca9eaa7 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [instance: 5632c271-69b0-4502-aa9f-3a1f9b85420a] Fetching instance by UUID {{(pid=124230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:12.430960 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-494e6723-b677-40c5-92e2-f68aaca9eaa7 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:12.431405 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-494e6723-b677-40c5-92e2-f68aaca9eaa7 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:12.432158 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-494e6723-b677-40c5-92e2-f68aaca9eaa7 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:12.432589 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG oslo_concurrency.lockutils [None req-494e6723-b677-40c5-92e2-f68aaca9eaa7 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Lock "a1da0db6-963b-492e-ab04-011cf8144663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:12.446331 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.wsgi [None req-494e6723-b677-40c5-92e2-f68aaca9eaa7 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] HTTP exception thrown: Instance 5632c271-69b0-4502-aa9f-3a1f9b85420a could not be found. Jun 16 00:42:12.447920 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-494e6723-b677-40c5-92e2-f68aaca9eaa7 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Request method failure captured: Jun 16 00:42:12.447920 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: request: GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a HTTP/1.1 Jun 16 00:42:12.447920 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept: application/json Jun 16 00:42:12.447920 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Accept-Encoding: identity Jun 16 00:42:12.447920 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Connection: close Jun 16 00:42:12.447920 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Length: 0 Jun 16 00:42:12.447920 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Content-Type: application/json Jun 16 00:42:12.447920 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Host: 10.222.0.23 Jun 16 00:42:12.447920 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Openstack-System-Scope: None Jun 16 00:42:12.447920 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: User-Agent: python-urllib3/1.26.9 Jun 16 00:42:12.447920 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Auth-Token: gAAAAABiqntQBQNHbtOcdmMJJ8INCI85muFj2qneAVPLp8KAMX-vVNEFoSjpJmBehRMjizXyCjSr9YsaC_1VN3268uF5r5AXHgW1OKPem-_EUjyofApVvuT9urjwL9B1hixirr6Abfz5BmJjzRnTVm0B_67HwgEUdKhYV7deyotAjQjhg4Ekgso Jun 16 00:42:12.447920 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Id: None Jun 16 00:42:12.447920 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Domain-Name: None Jun 16 00:42:12.447920 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Identity-Status: Confirmed Jun 16 00:42:12.447920 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Is-Admin-Project: True Jun 16 00:42:12.447920 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Id: default Jun 16 00:42:12.447920 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Domain-Name: Default Jun 16 00:42:12.447920 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Id: e831286870b24b39bc1f72f087bf970e Jun 16 00:42:12.447920 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Project-Name: tempest-TestShelveInstance-1966252772 Jun 16 00:42:12.447920 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Role: member,reader Jun 16 00:42:12.447920 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Roles: member,reader Jun 16 00:42:12.449689 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e831286870b24b39bc1f72f087bf970e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e831286870b24b39bc1f72f087bf970e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e831286870b24b39bc1f72f087bf970e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e831286870b24b39bc1f72f087bf970e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}] Jun 16 00:42:12.449689 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant: tempest-TestShelveInstance-1966252772 Jun 16 00:42:12.449689 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Id: e831286870b24b39bc1f72f087bf970e Jun 16 00:42:12.449689 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-Tenant-Name: tempest-TestShelveInstance-1966252772 Jun 16 00:42:12.449689 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User: tempest-TestShelveInstance-1966252772-project Jun 16 00:42:12.449689 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Id: default Jun 16 00:42:12.449689 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Domain-Name: Default Jun 16 00:42:12.449689 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Id: 218cff6f99a74a3f8e5cdd4e9787539d Jun 16 00:42:12.449689 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: X-User-Name: tempest-TestShelveInstance-1966252772-project Jun 16 00:42:12.449689 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: method: > Jun 16 00:42:12.449689 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: exception: Instance 5632c271-69b0-4502-aa9f-3a1f9b85420a could not be found. Jun 16 00:42:12.449689 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: action_args: {'id': '5632c271-69b0-4502-aa9f-3a1f9b85420a'} Jun 16 00:42:12.450900 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: {{(pid=124230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:42:12.450900 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:12.450900 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:42:12.450900 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:42:12.450900 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:42:12.450900 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:42:12.450900 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:42:12.450900 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:42:12.450900 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:42:12.450900 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:42:12.450900 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5632c271-69b0-4502-aa9f-3a1f9b85420a could not be found. Jun 16 00:42:12.450900 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:42:12.450900 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:42:12.450900 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:42:12.450900 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:12.450900 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:42:12.450900 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:42:12.450900 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:42:12.450900 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:42:12.450900 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:42:12.452643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:42:12.452643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:42:12.452643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:42:12.452643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:42:12.452643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:42:12.452643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:42:12.452643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:42:12.452643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5632c271-69b0-4502-aa9f-3a1f9b85420a could not be found. Jun 16 00:42:12.452643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:42:12.452643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:42:12.452643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:42:12.452643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:12.452643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:42:12.452643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:42:12.452643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:42:12.452643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:42:12.452643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5632c271-69b0-4502-aa9f-3a1f9b85420a could not be found. Jun 16 00:42:12.452643 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: ERROR nova.api.openstack.wsgi Jun 16 00:42:12.454283 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: DEBUG nova.api.openstack.wsgi [None req-494e6723-b677-40c5-92e2-f68aaca9eaa7 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Returning 404 to user: Instance 5632c271-69b0-4502-aa9f-3a1f9b85420a could not be found. {{(pid=124230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:42:12.454283 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO nova.api.openstack.requestlog [None req-494e6723-b677-40c5-92e2-f68aaca9eaa7 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a" status: 404 len: 111 microversion: 2.1 time: 0.030634 Jun 16 00:42:12.454283 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: [pid: 124230|app: 0|req: 523/1060] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:12 2022] GET /compute/v2.1/servers/5632c271-69b0-4502-aa9f-3a1f9b85420a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:42:12.613526 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: DEBUG nova.api.openstack.wsgi [None req-ec52019c-e924-458f-888e-0d0577ea82a4 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] Calling method '.version_select at 0x7fe704c1f310>' {{(pid=124231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:12.616655 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ec52019c-e924-458f-888e-0d0577ea82a4 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [684aab07-bf8c-4bc0-b2ac-99de4b1fd13f] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 00:42:13.623518 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO oslo.messaging._drivers.impl_rabbit [None req-ec52019c-e924-458f-888e-0d0577ea82a4 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] [684aab07-bf8c-4bc0-b2ac-99de4b1fd13f] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39236. Jun 16 00:42:13.643262 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO nova.api.openstack.requestlog [None req-ec52019c-e924-458f-888e-0d0577ea82a4 tempest-TestShelveInstance-1966252772 tempest-TestShelveInstance-1966252772-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-950829016" status: 202 len: 0 microversion: 2.1 time: 1.033700 Jun 16 00:42:13.643847 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: [pid: 124231|app: 0|req: 538/1061] 10.222.0.23 () {58 vars in 1250 bytes} [Thu Jun 16 00:42:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-950829016 => generated 0 bytes in 1035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:43:40.147892 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:43:40.148490 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Thu Jun 16 00:43:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:43:57.492349 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:43:57.493100 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Thu Jun 16 00:43:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:45:48.844566 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:45:48.845119 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Thu Jun 16 00:45:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:47:00.156267 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:47:00.156990 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Thu Jun 16 00:47:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:47:17.501083 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:47:17.501721 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Thu Jun 16 00:47:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:47:17.827555 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:47:17.828077 dv-cinder-845990-2-iscsi devstack@n-api.service[124231]: Thu Jun 16 00:47:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:47:32.238586 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:47:32.239172 dv-cinder-845990-2-iscsi devstack@n-api.service[124230]: Thu Jun 16 00:47:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!